#data-analytics #apache-arrow #data-science #machine-learning #codec #data-format #file-format

lance-encoding-datafusion

Encoders and decoders for the Lance file format that rely on datafusion

4 releases

new 0.12.2 Jun 13, 2024
0.12.1 Jun 5, 2024
0.12.0 Jun 4, 2024
0.11.1 May 29, 2024

#884 in Machine learning

Download history 80/week @ 2024-05-25 290/week @ 2024-06-01 89/week @ 2024-06-08

459 downloads per month

Apache-2.0

1MB
24K SLoC

lance-encoding-datafusion

lance-encoding-datafusion is an internal sub-crate, containing encoders and decoders for the Lance file format that rely on Datafusion. Partly this is to keep the size of lance-encoding small and partly this is to prove that encodings are extensible.

Important Note: This crate is not intended for external usage.

Dependencies

~76MB
~1.5M SLoC