Skip to content

zstandard support in input files #993

@bhearsum

Description

@bhearsum

Feature description

zstandard is a modern compression format that is optimized for size and decompression speed. In both these metrics it outperforms gzip/zlib (at the cost of slower compression times). When working with large models is a good candidate as an intermediate format due to these qualities.

It would be wonderful if marian could support natively decompressing these archives as it already does for gzip.

Citations on zstd vs gzip:

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions