Skip to content

Read generic variable-width offsets #8007

Description

@Xuanwo

Goal

Teach the Lance 2.3 variable-width reader to consume generic block-compressed offsets before any writer emits the new layout.

Scope

  • Decode offsets using descriptor-derived payload arity.
  • Validate cardinality, monotonicity, zero base, terminal offset, buffer counts, and arithmetic bounds.
  • Cover scan, range, take, multi-chunk, and malformed inputs.
  • Preserve legacy interleaved-flat reads.

Context

This is PR 4 of the Generic Block Compression stack extracted from #8002. It must land before the writer change.

Metadata

Metadata

Assignees

Labels

A-encodingEncoding, IO, file reader/writerA-formatOn-disk format: protos and format spec docsenhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions