Lib.rs

› Compression › Fluvio
#fluvio #side #consumer #data #streaming #producer

fluvio-compression

Fluvio Compression library

by Sehyo Chang and 60 contributors

11 releases

0.3.2 Oct 31, 2023
0.3.0 May 26, 2023
0.2.4 Mar 31, 2023
0.2.2 Dec 1, 2022
0.1.1 Mar 25, 2022

#178 in Compression

Download history 262/week @ 2024-01-03 672/week @ 2024-01-10 673/week @ 2024-01-17 302/week @ 2024-01-24 485/week @ 2024-01-31 386/week @ 2024-02-07 497/week @ 2024-02-14 443/week @ 2024-02-21 361/week @ 2024-02-28 336/week @ 2024-03-06 326/week @ 2024-03-13 580/week @ 2024-03-20 731/week @ 2024-03-27 1243/week @ 2024-04-03 514/week @ 2024-04-10 896/week @ 2024-04-17

3,439 downloads per month
Used in 9 crates (3 directly)

Apache-2.0

12KB
236 lines

Fluvio Compression

Library with handlers to compress and uncompress data in the fluvio protocol.

In fluvio, compression is done in producer side, then consumers and SPU when it is using SmartModules, uncompress the data using the compression information that is in the attributes of the batch.

Currently, the supported compressions codecs are None (default), Gzip, Snappy, Zstd and LZ4.

Dependencies

~0.4–1.7MB
~35K SLoC