14 breaking releases

0.24.0 Feb 3, 2025
0.22.1 Jan 21, 2025
0.21.1 Dec 16, 2024
0.20.0 Nov 26, 2024

#762 in Compression

Download history 206/week @ 2024-10-29 129/week @ 2024-11-05 435/week @ 2024-11-12 98/week @ 2024-11-19 197/week @ 2024-11-26 112/week @ 2024-12-03 113/week @ 2024-12-10 110/week @ 2024-12-17 2/week @ 2024-12-24 101/week @ 2024-12-31 118/week @ 2025-01-07 110/week @ 2025-01-14 193/week @ 2025-01-21 320/week @ 2025-01-28 150/week @ 2025-02-04 374/week @ 2025-02-11

1,059 downloads per month
Used in 4 crates (3 directly)

Apache-2.0

1MB
26K SLoC

Vortex FSST

A Vortex Encoding for Binary and Utf8 data that utilizes the Fast Static Symbol Table compression algorithm.


lib.rs:

An array that uses the Fast Static Symbol Table compression scheme to compress string arrays.

FSST arrays can generally compress string data up to 2x through the use of string tables. The string table is static for an entire array, and occupies up to 2048 bytes of buffer space. Thus, FSST is only worth reaching for when dealing with larger arrays of potentially hundreds of kilobytes or more.

Dependencies

~23–33MB
~497K SLoC