Lib.rs

Cargo Features

[dependencies]
datafusion = { version = "37.1.0", default-features = false, features = ["array_expressions", "avro", "backtrace", "compression", "crypto_expressions", "datetime_expressions", "encoding_expressions", "force_hash_collisions", "math_expressions", "parquet", "pyarrow", "regex_expressions", "serde", "unicode_expressions"] }

array_expressions default = datafusion-functions-array

Used to enable the avro format

default = array_expressions, compression, crypto_expressions, datetime_expressions, encoding_expressions, parquet, regex_expressions, unicode_expressions

These default features are set whenever datafusion is added without default-features = false somewhere in the dependency tree.

avro = apache-avro, num-traits

Enables avro of datafusion-common

Affects avro_to_arrow::read_avro_schema_from_reader…

backtrace

Enables backtrace of datafusion-common

compression default = async-compression, bzip2, flate2, tokio-util, xz2, zstd

crypto_expressions default

Enables crypto_expressions of datafusion-optimizer and datafusion-physical-expr

datetime_expressions default

Enables datetime_expressions of datafusion-functions

datafusion-functions:

enable datetime functions

encoding_expressions default

Enables encoding_expressions of datafusion-functions

datafusion-functions:

enable encode/decode functions

force_hash_collisions

Used for testing ONLY: causes all values to hash to the same value (test for collisions)

math_expressions

Enables math_expressions of datafusion-functions

datafusion-functions:

enable math functions

parquet default pyarrow?

Enables parquet, parquet of datafusion-common

Affects file_format::parquet, physical_plan::parquet, test_util::parquet…

pyarrow = parquet

Enables pyarrow of datafusion-common

regex_expressions default

Enables regex_expressions of datafusion-functions, datafusion-optimizer, and datafusion-physical-expr

datafusion-functions:

enable regular expressions

serde

Enables serde of arrow-schema

unicode_expressions default

Enables unicode_expressions of datafusion-functions, datafusion-optimizer, datafusion-physical-expr, and datafusion-sql

datafusion-functions:

enable unicode functions

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

apache-avro avro?

async-compression compression

bzip2 compression

datafusion-functions-array array_expressions

flate2 compression

num-traits avro?

tokio-util compression

xz2 compression

zstd compression