33 major breaking releases

43.0.0 Nov 8, 2024
42.2.0 Nov 4, 2024
42.1.0 Oct 20, 2024
41.0.0 Aug 11, 2024
9.0.0 Jun 13, 2022

#68 in Database interfaces

Download history 180114/week @ 2024-07-28 167257/week @ 2024-08-04 185510/week @ 2024-08-11 210671/week @ 2024-08-18 198594/week @ 2024-08-25 168192/week @ 2024-09-01 199097/week @ 2024-09-08 179172/week @ 2024-09-15 207454/week @ 2024-09-22 209419/week @ 2024-09-29 232844/week @ 2024-10-06 198157/week @ 2024-10-13 239994/week @ 2024-10-20 277103/week @ 2024-10-27 206545/week @ 2024-11-03 201671/week @ 2024-11-10

931,994 downloads per month
Used in 131 crates (8 directly)

Apache-2.0

2.5MB
46K SLoC

DataFusion SQL Query Planner

This crate provides a general purpose SQL query planner that can parse SQL and translate queries into logical plans. Although this crate is used by the DataFusion query engine, it was designed to be easily usable from any project that requires a SQL query planner and does not make any assumptions about how the resulting logical plan will be translated to a physical plan. For example, there is no concept of row-based versus columnar execution in the logical plan.

Example Usage

See the examples directory for fully working examples.

Here is an example of producing a logical plan from a SQL string.

fn main() {
    let sql = "SELECT \
            c.id, c.first_name, c.last_name, \
            COUNT(*) as num_orders, \
            SUM(o.price) AS total_price, \
            SUM(o.price * s.sales_tax) AS state_tax \
        FROM customer c \
        JOIN state s ON c.state = s.id \
        JOIN orders o ON c.id = o.customer_id \
        WHERE o.price > 0 \
        AND c.last_name LIKE 'G%' \
        GROUP BY 1, 2, 3 \
        ORDER BY state_tax DESC";

    // parse the SQL
    let dialect = GenericDialect {}; // or AnsiDialect, or your own dialect ...
    let ast = Parser::parse_sql(&dialect, sql).unwrap();
    let statement = &ast[0];

    // create a logical query plan
    let schema_provider = MySchemaProvider::new();
    let sql_to_rel = SqlToRel::new(&schema_provider);
    let plan = sql_to_rel.sql_statement_to_plan(statement.clone()).unwrap();

    // show the plan
    println!("{:?}", plan);
}

This is the logical plan that is produced from this example. Note that this is an unoptimized logical plan. The datafusion-optimizer crate provides a query optimizer that can be applied to plans produced by this crate.

Sort: state_tax DESC NULLS FIRST
  Projection: c.id, c.first_name, c.last_name, COUNT(Int64(1)) AS num_orders, SUM(o.price) AS total_price, SUM(o.price * s.sales_tax) AS state_tax
    Aggregate: groupBy=[[c.id, c.first_name, c.last_name]], aggr=[[COUNT(Int64(1)), SUM(o.price), SUM(o.price * s.sales_tax)]]
      Filter: o.price > Int64(0) AND c.last_name LIKE Utf8("G%")
        Inner Join: c.id = o.customer_id
          Inner Join: c.state = s.id
            SubqueryAlias: c
              TableScan: customer
            SubqueryAlias: s
              TableScan: state
          SubqueryAlias: o
            TableScan: orders

Dependencies

~20–30MB
~450K SLoC