#arrow #csv

app csv2arrow

Convert CSV files to Arrow

9 releases

0.4.0 May 19, 2022
0.3.1 Feb 24, 2022
0.3.0 Apr 26, 2021
0.2.1 Mar 5, 2021
0.1.3 Feb 27, 2021

#22 in #arrow

Download history 1/week @ 2022-03-05 22/week @ 2022-03-12 33/week @ 2022-03-19 2/week @ 2022-03-26 4/week @ 2022-04-02 4/week @ 2022-04-09 2/week @ 2022-04-16 14/week @ 2022-04-23 33/week @ 2022-04-30 54/week @ 2022-05-07 164/week @ 2022-05-14 40/week @ 2022-05-21 76/week @ 2022-05-28 59/week @ 2022-06-04 3/week @ 2022-06-11 2/week @ 2022-06-18

142 downloads per month

MIT/Apache

13KB
93 lines

CSV to Arrow

Crates.io Rust

Convert CSV files to Apache Arrow. You may also be interested in json2arrow, csv2parquet, or json2parquet.

Installation

Download prebuilt binaries

You can get the latest releases from https://github.com/domoritz/csv2arrow/releases/.

With Cargo

cargo install csv2arrow

Usage

USAGE:
    csv2arrow [OPTIONS] <CSV> [ARROW]

ARGS:
    <CSV>      Input CSV file
    <ARROW>    Output file, stdout if not present

OPTIONS:
    -d, --delimiter <DELIMITER>
            Set the CSV file's column delimiter as a byte character [default: ,]

    -h, --header <HEADER>
            Set whether the CSV file has headers

        --help
            Print help information

    -m, --max-read-records <MAX_READ_RECORDS>
            The number of records to infer the schema from. All rows if not present. Setting max-
            read-records to zero will stop schema inference and all columns will be string typed

    -n, --dry
            Only print the schema

    -p, --print-schema
            Print the schema to stderr

    -V, --version
            Print version information

For Developers

To format the code, run

cargo clippy && cargo fmt

Dependencies

~11MB
~217K SLoC