6 releases (breaking)

0.12.0 Oct 3, 2024
0.11.0 Sep 26, 2024
0.10.1 Sep 20, 2024
0.9.0 Sep 17, 2024
0.7.0 Aug 19, 2024

#375 in Database implementations

Download history 125/week @ 2024-08-15 29/week @ 2024-08-22 13/week @ 2024-08-29 24/week @ 2024-09-05 81/week @ 2024-09-12 241/week @ 2024-09-19 181/week @ 2024-09-26 152/week @ 2024-10-03

658 downloads per month
Used in vortex-sampling-compresso…

Apache-2.0

720KB
17K SLoC

Vortex FSST

A Vortex Encoding for Binary and Utf8 data that utilizes the Fast Static Symbol Table compression algorithm.


lib.rs:

An array that uses the Fast Static Symbol Table compression scheme to compress string arrays.

FSST arrays can generally compress string data up to 2x through the use of string tables. The string table is static for an entire array, and occupies up to 2048 bytes of buffer space. Thus, FSST is only worth reaching for when dealing with larger arrays of potentially hundreds of kilobytes or more.

Dependencies

~14–20MB
~273K SLoC