#transformation #pipeline #data-pipeline #flexible #csv #output #chainable

pipecrafter

A flexible, chainable data transformation pipeline for Rust

2 releases

new 0.1.1 Oct 31, 2024
0.1.0 Oct 30, 2024

#27 in #transformation

25 downloads per month

MIT license

5KB
58 lines

pipecrafter

PipeCrafter is a flexible, chainable data transformation pipeline library for Rust, designed to make data ingestion, transformation, and output easier for Rust projects.

Features

  • Data Ingestion: Easily ingest data from various sources (e.g., CSV, JSON).
  • Flexible Transformations: Chain transformations like map, filter, and custom functions.
  • Output Options: Output data to files, stdout, or custom sinks.

Example Usage

use pipecrafter::{CsvSource, Pipeline, UppercaseTransform, print_output};

fn main() {
    let source = Box::new(CsvSource);
    let pipeline = Pipeline::new(source).add_transformation(Box::new(UppercaseTransform));
    
    let result = pipeline.execute().expect("Pipeline execution failed");
    print_output(result);
}

Getting Started

Add pipecrafter to your Cargo.toml dependencies

Import the necessary components and build your data pipeline!

License

MIT License

Author

Ben Santora (bensatlantik@gmail.com)

Dependencies

~1.5–2.3MB
~35K SLoC