#parquet #hadoop

parquet-format

Apache Parquet Format - thrift definition and generated Rust file

6 stable releases

4.0.0 Jan 11, 2021
3.0.0 Jan 10, 2021
2.7.0 Jan 8, 2021
2.6.1 Jun 6, 2020
2.4.0 Apr 12, 2018

#161 in Database interfaces

Download history 10141/week @ 2021-07-01 9524/week @ 2021-07-08 10336/week @ 2021-07-15 9373/week @ 2021-07-22 9895/week @ 2021-07-29 10142/week @ 2021-08-05 8726/week @ 2021-08-12 9552/week @ 2021-08-19 7962/week @ 2021-08-26 6081/week @ 2021-09-02 8220/week @ 2021-09-09 7534/week @ 2021-09-16 5741/week @ 2021-09-23 6283/week @ 2021-09-30 8898/week @ 2021-10-07 6846/week @ 2021-10-14

27,820 downloads per month
Used in 28 crates (2 directly)

Apache-2.0

220KB
5K SLoC

parquet-format-rs

Build Status License

Apache Parquet format for Rust, hosting the Thrift definition file and the generated .rs file.

Usage and Versioning Policy

This crate previously tracked the Parquet format versions, which made keeping semver guarantees sometimes challenging. As of version 3.0.0 of the crate, independent major versions are used whenever we update the Parquet format.

The below summarises the version mappings.

parquet-format parquet-format-rs
2.8.0 4.0.*
2.7.0 3.0.*
2.6.0 2.6.*
2.5.0 2.5.*
2.4.0 2.4.*

Updating Parquet format

  • Update the parquet.thrift file
  • Run ./generate_parquet_format.sh
  • Commit changes

Note that the major version should be incremented when updating to a new Parquet format version.

Dependencies

~800KB
~16K SLoC