Skip to content

feature: add extended zstd compressors for upcoming mzML update#198

Draft
mobiusklein wants to merge 1 commit intolevitsky:masterfrom
mobiusklein:feature/zstd_compression
Draft

feature: add extended zstd compressors for upcoming mzML update#198
mobiusklein wants to merge 1 commit intolevitsky:masterfrom
mobiusklein:feature/zstd_compression

Conversation

@mobiusklein
Copy link
Copy Markdown
Contributor

This PR adds support for reading recently added Zstandard based compression codecs proposed as part of the DIA and ion mobility mzML update.

This adds:

  • plain zstd-based compression like we currently have for zlib
  • zstd + numpress compression, like was previously added
  • two new lossless codecs that transform the data to make it more compressible when certain conditions are met, and then compresses them with zstd, byte shuffling for sorted data (e.g. m/z, time) or dictionary encoding for repeated data (m/z, ion mobility, charge state).

This is currently a draft because it does not have tests. There are few sources yet, but support has been added to ProteoWizard. I just need to make sure to keep spreading it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant