Skip to content

TEMPORARY BRANCH FOR ZERO-COPY VERSION PERFORMANCE DEBUGGING#229

Merged
avalerio-tkd merged 14 commits into
mainfrom
av_typelist_optimizing_079
Mar 17, 2026
Merged

TEMPORARY BRANCH FOR ZERO-COPY VERSION PERFORMANCE DEBUGGING#229
avalerio-tkd merged 14 commits into
mainfrom
av_typelist_optimizing_079

Conversation

@avalerio-tkd

Copy link
Copy Markdown
Collaborator

No description provided.

- Made various functions inline to avoid extra function calls
- Marked various functions as inline
- Switched to ues XorEncryptInto
…aders+level bytes without actually reading the value bytes.

- num_elements for DICTIONARY_PAGE and DATA_PAGE_V2 pages read from the headers values directly (easy)
- num_elements for DATA_PAGE_V1 pages read from the level bytes and RLE bit decoding (hard!)
- Added unittests for RLE bit decoding and count present values from definition levels for DATA_PAGE_V1 pages.
- Updated all scripts and unittests for new Parquet parsing requirements.
…XorEncryptor.

- Now num_elements is an invariant / constant all along TypedValuesBuffer and BasicXorEncryptor (Yay!)
- Fixed issue on iterator to account for prefix size on input buffers.
- Many unittest fixes for interfaces updates for num_elements.
@avalerio-tkd avalerio-tkd merged commit ccfb079 into main Mar 17, 2026
2 checks passed
@avalerio-tkd avalerio-tkd deleted the av_typelist_optimizing_079 branch March 17, 2026 02:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant