9 major breaking releases

25.0.0 May 23, 2023
24.0.0 May 9, 2023
23.0.0 Apr 24, 2023
22.0.0 Apr 10, 2023
0.1.0 Dec 16, 2022

#293 in Parser implementations

Download history 218/week @ 2023-02-08 83/week @ 2023-02-15 221/week @ 2023-02-22 133/week @ 2023-03-01 71/week @ 2023-03-08 130/week @ 2023-03-15 81/week @ 2023-03-22 97/week @ 2023-03-29 91/week @ 2023-04-05 289/week @ 2023-04-12 317/week @ 2023-04-19 378/week @ 2023-04-26 927/week @ 2023-05-03 954/week @ 2023-05-10 782/week @ 2023-05-17 776/week @ 2023-05-24

3,472 downloads per month
Used in 2 crates

Apache-2.0

3MB
61K SLoC

DataFusion + Substrait

Substrait provides a cross-language serialization format for relational algebra, based on protocol buffers.

This repository provides a Substrait producer and consumer for DataFusion:

  • The producer converts a DataFusion logical plan into a Substrait protobuf.
  • The consumer converts a Substrait protobuf into a DataFusion logical plan.

Potential uses of this crate:

  • Replace the current DataFusion protobuf definition used in Ballista for passing query plan fragments to executors
  • Make it easier to pass query plans over FFI boundaries, such as from Python to Rust
  • Allow Apache Calcite query plans to be executed in DataFusion

Dependencies

~37–72MB
~1.5M SLoC