0.0.0	Sep 16, 2024

Apache-2.0

6KB

RBIR

RBIR stands for Rewrite Bigdata in Rust. RBIR aims to create a big data ecosystem using Rust.

This project declares our manifesto and serves as a collection of RBIR projects and posts for anyone interested in joining this journey.

Projects

tikv: Distributed transactional key-value database
databend: A Rust data warehouse, alternative to Snowflake
quickwit: A Rust search engine, alternative to Elasticsearch
risingwave: Rust streaming processing engine
Apache DataFusion: Fast, extensible query engine built in rust
influxdb: Scalable datastore for metrics, events, and real-time analytics
greptimedb: Time series database for metrics, logs and events
Apache HoraeDB (incubating): High-performance, distributed, cloud native time-series database
paradedb: Postgres for Search and Analytics
glaredb: An analytics DBMS for distributed data
fluvio: Lean and mean distributed stream processing system
lancedb: Developer-friendly, database for multimodal AI
slatedb: Cloud-native embedded storage engine built on object storage
daft: Distributed DataFrame for Python designed for the cloud, powered by Rust
arroyo: Distributed stream processing engine written in Rust, designed to perform stateful computations on data

Apache OpenDAL provides python, nodejs, java, go bindings
Apache Iceberg is now working on building rust core for pyiceberg
Apache Paimon is going to build paimon-py by its rust core
Apache DataFusion Comet is a high-performance accelerator for Apache Spark
blaze: The Blaze accelerator for Apache Spark leverages native vectorized execution to accelerate query processing
Apache Uniffle is working on it's rust shuffle server at incubator-uniffle/rust/experimental/server