#data-pipeline #pipeline #etl #aqueducts #cli-applications #data #cli

app aqueducts-cli

CLI application to run pipelines defined for the aqueducts framework

16 releases (6 breaking)

new 0.7.1 Dec 9, 2024
0.7.0 Nov 29, 2024
0.6.3 Oct 31, 2024
0.4.0 Jul 28, 2024

#545 in Command line utilities

Download history 16/week @ 2024-08-23 1/week @ 2024-09-06 134/week @ 2024-09-13 50/week @ 2024-09-20 319/week @ 2024-09-27 39/week @ 2024-10-04 16/week @ 2024-10-11 3/week @ 2024-10-18 77/week @ 2024-10-25 77/week @ 2024-11-01 30/week @ 2024-11-08 13/week @ 2024-11-15 7/week @ 2024-11-22 131/week @ 2024-11-29 125/week @ 2024-12-06

277 downloads per month

Custom license

115KB
1.5K SLoC

Aqueducts CLI

Example CLI application utilizing the Aqueducts framework to run ETL pipelines declared in YAML.

Install

# install with default features (s3, gcs, azure)
cargo install aqueducts-cli

# install with odbc support
cargo install aqueducts-cli --features odbc

# install with s3 support only
cargo install aqueducts-cli --no-default-features --features s3

Run

aqueducts --file ./example.yml --param key1=value1 --param key2=value2  

Dependencies

~62–85MB
~1.5M SLoC