Skip to content

Add robust dataset loader utility for inconsistent .npy formats #178

@abhiram123467

Description

@abhiram123467

Problem

DeepLense .npy files exist in 3 different formats with no
documentation or utility to handle them:

  1. Plain (64,64) float arrays
  2. Object arrays of 64 row-vectors each of shape (64,)
  3. Flat (4096,) arrays with label appended as extra row

This causes ValueError for new contributors trying to
load the dataset.

Solution

Add a dataset_utils.py with a robust loader that
automatically detects and handles all 3 formats.

I would like to work on this fix.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions