1 unstable release
0.0.1 | Dec 27, 2023 |
---|
#20 in #etl
33KB
724 lines
Rusty Pipes
A library that enables you to declaratively define your data sources and transformation pipelines, with an engine to fetch data and run said pipeline
Please refer to the examples for a sense of how this library can be used.
For now, this library is relatively bare-bones. It contains one Loader (for CSV files) and two transformations (Filter and Inner Join).
Contributions
Contributions are most welcome; the plan is to provide a wider variety of Loaders (e.g., a
Postgres-based loader) as well as many more Transformations. These should be relatively straightforward to implement:
Loaders must implement the Loader
trait and Transformations must implement the Transformation
trait. That's it.
Dependencies
~2.8–4MB
~67K SLoC