#parquet #hadoop #format #file-format #thrift #apache #generated

parquet-format

Apache Parquet Format - thrift definition and generated Rust file

6 stable releases

4.0.0 Jan 11, 2021
3.0.0 Jan 10, 2021
2.7.0 Jan 8, 2021
2.6.1 Jun 6, 2020
2.4.0 Apr 12, 2018

#1694 in Parser implementations

Download history 2484/week @ 2024-07-24 2278/week @ 2024-07-31 3768/week @ 2024-08-07 3014/week @ 2024-08-14 4683/week @ 2024-08-21 3722/week @ 2024-08-28 3866/week @ 2024-09-04 5119/week @ 2024-09-11 3506/week @ 2024-09-18 3101/week @ 2024-09-25 3093/week @ 2024-10-02 3987/week @ 2024-10-09 5003/week @ 2024-10-16 3677/week @ 2024-10-23 4416/week @ 2024-10-30 3172/week @ 2024-11-06

17,300 downloads per month

Apache-2.0

220KB
5K SLoC

parquet-format-rs

Build Status License

Apache Parquet format for Rust, hosting the Thrift definition file and the generated .rs file.

Usage and Versioning Policy

This crate previously tracked the Parquet format versions, which made keeping semver guarantees sometimes challenging. As of version 3.0.0 of the crate, independent major versions are used whenever we update the Parquet format.

The below summarises the version mappings.

parquet-format parquet-format-rs
2.8.0 4.0.*
2.7.0 3.0.*
2.6.0 2.6.*
2.5.0 2.5.*
2.4.0 2.4.*

Updating Parquet format

  • Update the parquet.thrift file
  • Run ./generate_parquet_format.sh
  • Commit changes

Note that the major version should be incremented when updating to a new Parquet format version.

Dependencies

~1MB
~17K SLoC