#engine #partitioning #management #structures #fluxus-core

fluxus-core

Core components for Fluxus stream processing engine

4 releases

Uses new Rust 2024

new 0.1.3 Apr 24, 2025
0.1.2 Apr 24, 2025
0.1.1 Apr 23, 2025
0.1.0 Apr 23, 2025

#275 in Configuration

Download history 139/week @ 2025-04-17

141 downloads per month
Used in 3 crates

Apache-2.0

69KB
1.5K SLoC

Fluxus Core - A Flink-like stream processing engine in Rust

This module contains the core abstractions and data types for stream processing.


Fluxus Core

Core implementations and data structures for the Fluxus stream processing engine.

Overview

This crate provides the fundamental building blocks and implementations for the Fluxus stream processing engine:

  • Window implementations
  • State management
  • Data partitioning
  • Runtime configurations
  • Core data structures

Key Components

Windows

Core window implementations:

  • TumblingWindow - Fixed-size, non-overlapping windows
  • SlidingWindow - Overlapping windows with slide interval
  • SessionWindow - Dynamic windows based on event timing

State Management

State handling for stream operations:

  • In-memory state storage
  • State backends
  • Checkpointing (planned)

Partitioning

Data partitioning strategies:

  • Key-based partitioning
  • Round-robin partitioning
  • Custom partitioners

Usage

Add this to your Cargo.toml:

[dependencies]
fluxus-core = "0.1"

This crate is usually not used directly but through the fluxus-api crate.

Dependencies

~5–13MB
~120K SLoC