#transformation #pipeline #data-pipeline #flexible #csv #output #chainable

pipecrafter

A flexible, chainable data transformation pipeline for Rust

3 releases

0.1.2 Nov 21, 2024
0.1.1 Oct 31, 2024
0.1.0 Oct 30, 2024

#26 in #transformation

Download history 248/week @ 2024-10-28 8/week @ 2024-11-04 147/week @ 2024-11-18 4/week @ 2024-11-25 8/week @ 2024-12-02

161 downloads per month

MIT license

5KB
58 lines

pipecrafter

PipeCrafter is a flexible, chainable data transformation pipeline library for Rust, designed to make data ingestion, transformation, and output easier for Rust projects.

Features

  • Data Ingestion: Easily ingest data from various sources (e.g., CSV, JSON).
  • Flexible Transformations: Chain transformations like map, filter, and custom functions.
  • Output Options: Output data to files, stdout, or custom sinks.

Example Usage

use pipecrafter::{CsvSource, Pipeline, UppercaseTransform, print_output};

fn main() {
    let source = Box::new(CsvSource);
    let pipeline = Pipeline::new(source).add_transformation(Box::new(UppercaseTransform));
    
    let result = pipeline.execute().expect("Pipeline execution failed");
    print_output(result);
}

Getting Started

Add pipecrafter to your Cargo.toml dependencies

Import the necessary components and build your data pipeline!

License

MIT License

Author

bensatlantik

Dependencies

~1.4–2.2MB
~33K SLoC