#numcodecs #zfp

numcodecs-zfp

ZFP codec implementation for the numcodecs API

9 releases (4 breaking)

new 0.5.1 Apr 5, 2025
0.5.0 Apr 4, 2025
0.4.0 Mar 13, 2025
0.3.1 Feb 6, 2025
0.1.0 Aug 22, 2024

#1032 in Compression

Download history 14/week @ 2024-12-18 1/week @ 2025-01-08 33/week @ 2025-01-22 204/week @ 2025-01-29 223/week @ 2025-02-05 13/week @ 2025-02-12 79/week @ 2025-02-19 7/week @ 2025-02-26 9/week @ 2025-03-05 157/week @ 2025-03-12 107/week @ 2025-03-19 121/week @ 2025-03-26 327/week @ 2025-04-02

713 downloads per month

MPL-2.0 license

88KB
1.5K SLoC

CI Status MSRV Latest Version PyPi Release Rust Doc Crate Rust Doc Main Read the Docs

numcodecs-zfp

ZFP codec implementation for the numcodecs API.

This implementation uses ZFP's ZFP_ROUNDING_MODE=ZFP_ROUND_FIRST and ZFP_WITH_TIGHT_ERROR=ON experimental features to reduce the bias and correlation in ZFP's errors (see https://zfp.readthedocs.io/en/release1.0.1/faq.html#zfp-rounding).

This implementation also rejects non-reversibly compressing non-finite (infinite or NaN) values, since ZFP's behaviour for them is undefined (see https://zfp.readthedocs.io/en/release1.0.1/faq.html#q-valid).

Please see the numcodecs-zfp-classic codec for an implementation that uses ZFP without these modifications.

License

Licensed under the Mozilla Public License, Version 2.0 (LICENSE or https://www.mozilla.org/en-US/MPL/2.0/).

Funding

The numcodecs-zfp crate has been developed as part of ESiWACE3, the third phase of the Centre of Excellence in Simulation of Weather and Climate in Europe.

Funded by the European Union. This work has received funding from the European High Performance Computing Joint Undertaking (JU) under grant agreement No 101093054.

Dependencies

~4.5–8MB
~162K SLoC