8 releases (breaking)

new 0.14.0 Nov 4, 2024
0.13.1 Nov 1, 2024
0.12.0 Oct 3, 2024
0.11.0 Sep 26, 2024
0.7.0 Aug 19, 2024

#433 in Database implementations

Download history 148/week @ 2024-08-19 13/week @ 2024-08-26 19/week @ 2024-09-02 18/week @ 2024-09-09 273/week @ 2024-09-16 194/week @ 2024-09-23 173/week @ 2024-09-30 33/week @ 2024-10-07 49/week @ 2024-10-14 27/week @ 2024-10-21 132/week @ 2024-10-28

249 downloads per month
Used in vortex-sampling-compresso…

Apache-2.0

1MB
18K SLoC

Vortex FSST

A Vortex Encoding for Binary and Utf8 data that utilizes the Fast Static Symbol Table compression algorithm.


lib.rs:

An array that uses the Fast Static Symbol Table compression scheme to compress string arrays.

FSST arrays can generally compress string data up to 2x through the use of string tables. The string table is static for an entire array, and occupies up to 2048 bytes of buffer space. Thus, FSST is only worth reaching for when dealing with larger arrays of potentially hundreds of kilobytes or more.

Dependencies

~16–23MB
~312K SLoC