19 major breaking releases

new 36.0.0 Feb 20, 2024
35.0.0 Jan 25, 2024
34.0.0 Dec 17, 2023
33.0.0 Nov 16, 2023
0.1.0 Dec 16, 2022

#283 in Database interfaces

Download history 497/week @ 2023-10-30 738/week @ 2023-11-06 338/week @ 2023-11-13 228/week @ 2023-11-20 265/week @ 2023-11-27 173/week @ 2023-12-04 200/week @ 2023-12-11 188/week @ 2023-12-18 271/week @ 2023-12-25 381/week @ 2024-01-01 197/week @ 2024-01-08 99/week @ 2024-01-15 206/week @ 2024-01-22 1440/week @ 2024-01-29 1129/week @ 2024-02-05 1296/week @ 2024-02-12

4,085 downloads per month
Used in 8 crates (3 directly)

Apache-2.0

2.5MB
49K SLoC

DataFusion + Substrait

Substrait provides a cross-language serialization format for relational algebra, based on protocol buffers.

This repository provides a Substrait producer and consumer for DataFusion:

  • The producer converts a DataFusion logical plan into a Substrait protobuf.
  • The consumer converts a Substrait protobuf into a DataFusion logical plan.

Potential uses of this crate:

  • Replace the current DataFusion protobuf definition used in Ballista for passing query plan fragments to executors
  • Make it easier to pass query plans over FFI boundaries, such as from Python to Rust
  • Allow Apache Calcite query plans to be executed in DataFusion

Dependencies

~43–60MB
~1M SLoC