#data-pipeline #pipeline #etl #aqueducts #cli-applications #data #cli

app aqueducts-cli

CLI application to run pipelines defined for the aqueducts framework

14 releases (5 breaking)

0.6.3 Oct 31, 2024
0.6.2 Sep 30, 2024
0.5.0 Aug 20, 2024
0.4.0 Jul 28, 2024
0.1.2 May 22, 2024

#708 in Command line utilities

Download history 6/week @ 2024-07-20 243/week @ 2024-07-27 4/week @ 2024-08-03 129/week @ 2024-08-17 10/week @ 2024-08-24 1/week @ 2024-08-31 142/week @ 2024-09-14 148/week @ 2024-09-21 226/week @ 2024-09-28 28/week @ 2024-10-05 15/week @ 2024-10-12 2/week @ 2024-10-19 107/week @ 2024-10-26 66/week @ 2024-11-02

192 downloads per month

Custom license

115KB
1.5K SLoC

Aqueducts CLI

Example CLI application utilizing the Aqueducts framework to run ETL pipelines declared in YAML.

Install

# install with default features (s3, gcs, azure)
cargo install aqueducts-cli

# install with odbc support
cargo install aqueducts-cli --features odbc

# install with s3 support only
cargo install aqueducts-cli --no-default-features --features s3

Run

aqueducts --file ./example.yml --param key1=value1 --param key2=value2  

Dependencies

~60–83MB
~1.5M SLoC