91 releases (53 major breaking)
53.3.0 | Nov 20, 2024 |
---|---|
53.0.0 | Sep 3, 2024 |
52.2.0 | Jul 28, 2024 |
51.0.0 | Mar 18, 2024 |
0.3.0 | May 5, 2018 |
#7 in Compression
555,744 downloads per month
Used in 302 crates
(115 directly)
4MB
80K
SLoC
Apache Parquet Official Native Rust Implementation
This crate contains the official Native Rust implementation of Apache Parquet, which is part of the Apache Arrow project.
See the API documentation for examples and the full API.
The API documentation for most recent, unreleased code is available here.
Rust Version Compatibility
This crate is tested with the latest stable version of Rust. We do not currently test against other, older versions of the Rust compiler.
Versioning / Releases
The parquet
crate follows the SemVer standard defined by Cargo and works well
within the Rust crate ecosystem. See the repository README for more details on
the release schedule and version.
Note that for historical reasons, this crate uses versions with major numbers
greater than 0.x
(e.g. 19.0.0
), unlike many other crates in the Rust
ecosystem which spend extended time releasing versions 0.x
to signal planned
ongoing API changes. Minor arrow releases contain only compatible changes, while
major releases may contain breaking API changes.
Feature Flags
The parquet
crate provides the following features which may be enabled in your Cargo.toml
:
arrow
(default) - support for reading / writingarrow
arrays to / from parquetasync
- supportasync
APIs for reading parquetjson
- support for reading / writingjson
data to / from parquetbrotli
(default) - support for parquet usingbrotli
compressionflate2
(default) - support for parquet usinggzip
compressionlz4
(default) - support for parquet usinglz4
compressionzstd
(default) - support for parquet usingzstd
compressionsnap
(default) - support for parquet usingsnappy
compressioncli
- parquet CLI toolscrc
- enables functionality to automatically verify checksums of each page (if present) when decodingexperimental
- Experimental APIs which may change, even between minor releases
Parquet Feature Status
- All encodings supported
- All compression codecs supported
- Read support
- Primitive column value readers
- Row record reader
- Arrow record reader
- Async support (to Arrow)
- Statistics support
- Write support
- Primitive column value writers
- Row record writer
- Arrow record writer
- Async support
- Predicate pushdown
- Parquet format 4.0.0 support
License
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0.
Dependencies
~13–43MB
~824K SLoC