Skip to content

Add support for more metadata field types #630

Description

@jan-niestadt

Currently, BlackLab supports metadata fields with these types:

  • tokenized or untokenized (text)
  • numeric (integer)

It would be useful to include more types that Lucene supports natively, such as:

  • specific numeric types: integer, long, float, double
  • range of one of the number types, e.g. integer-range
  • byte-vector / float-vector (nearest neighbour) (e.g. for embeddings)
  • lat-long (latitude/longitude)
  • etc., see Field

A date type would also be useful, although that doesn't seem to be natively supported by Lucene. If we add date fields, we should be very clear about what we do and do not support (only e.g. YYYY-MM-DD? Partial dates like YYYY or YYYY-MM or MM-DD? Or even a full timestamp with timezone etc. (probably don't do this until there's a clear need)

With these explicit field types, the frontend could choose a more appropriate default widget for the field.

(#618 describes a use case for floating point)

Metadata

Metadata

Assignees

No one assigned

    Labels

    discussenhancementindexingIssues relates to indexing datarefactorProposed internal reorganization or cleanup of the code

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions