41 releases (breaking)
Uses new Rust 2024
| 0.58.0 | Jan 7, 2026 |
|---|---|
| 0.57.0-rc.0 | Dec 8, 2025 |
| 0.56.0 | Nov 17, 2025 |
| 0.42.1 | Jul 24, 2025 |
| 0.25.2 | Mar 3, 2025 |
#12 in #compressor
18,744 downloads per month
Used in 7 crates
(2 directly)
5MB
111K
SLoC
Vortex's BtrBlocks-inspired adaptive compression framework.
This crate provides a sophisticated multi-level compression system that adaptively selects optimal compression schemes based on data characteristics. The compressor analyzes arrays to determine the best encoding strategy, supporting cascaded compression with multiple encoding layers for maximum efficiency.
Key Features
- Adaptive Compression: Automatically selects the best compression scheme based on data patterns
- Type-Specific Compressors: Specialized compression for integers, floats, strings, and temporal data
- Cascaded Encoding: Multiple compression layers can be applied for optimal results
- Statistical Analysis: Uses data sampling and statistics to predict compression ratios
- Recursive Structure Handling: Compresses nested structures like structs and lists
Example
use vortex_btrblocks::BtrBlocksCompressor;
use vortex_array::Array;
let compressor = BtrBlocksCompressor::default();
// let compressed = compressor.compress(&array)?;
Vortex BtrBlocks Compressor
Compressor decision tree
Dependencies
~38MB
~582K SLoC