#data-pipeline #pipeline #etl #data #cli-applications #cli #aqueducts

app aqueducts-cli

CLI application to run pipelines defined for the aqueducts framework

7 releases

new 0.3.0 Jun 24, 2024
0.2.2 May 27, 2024
0.1.2 May 22, 2024

#353 in Command line utilities

Download history 603/week @ 2024-05-21 114/week @ 2024-05-28 14/week @ 2024-06-04 3/week @ 2024-06-11

734 downloads per month

Custom license

110KB
1.5K SLoC

Aqueducts CLI

Example CLI application utilizing the Aqueducts framework to run ETL pipelines declared in YAML.

Install

# install with default features (s3, gcs, azure)
cargo install aqueducts-cli

# install with odbc support
cargo install aqueducts-cli --features odbc

# install with s3 support only
cargo install aqueducts-cli --no-default-features --features s3

Run

aqueducts --file ./example.yml --param key1=value1 --param key2=value2  

Dependencies

~56–78MB
~1.5M SLoC