Lib.rs

redb

Rust Embedded DataBase

surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

indicium

in-memory search for collections and key-value stores

fjall

LSM-based key-value storage engine

tantivy

Search engine library

rustsec

Client library for the RustSec security advisory database

sonic-server

Fast, lightweight and schema-less search backend

dittolive-ditto

Ditto is a peer to peer cross-platform database that allows mobile, web, IoT and server apps to sync with or without an internet connection

oxigraph

a SPARQL database and RDF toolkit

datafusion-functions-json

JSON functions for DataFusion

fastdivide

partial port of libdivide. It makes it possible to reduce the cost of divisions.

marble

garbage-collecting on-disk object store

worterbuch

A message broker / database hybrid

grovedb

Fully featured database using balanced hierarchical authenticated data structures

vortex-fastlanes

Vortex fastlanes arrays

pyo3-polars

Expression plugins and PyO3 types for polars

izihawa-tantivy-sstable

sstables for tantivy

gostd

go standard library implementation in rust. gostd 是Go标准库的rust实现

persy

Transactional Persistence Engine

datafusion-python

Apache DataFusion DataFrame and SQL Query Engine

vortex-datetime-dtype

Vortex datetime extension dtype

ballista

Distributed Compute

metasearch

a cute metasearch engine

seekstorm

Search engine library & multi-tenancy server

lancedb

serverless, low-latency vector database for AI applications

izihawa-tantivy-columnar

column oriented storage for tantivy

polars-lazy

Lazy query engine for the Polars DataFrame library

tickv

(Tiny Circular Key Value) is a small file system allowing key value pairs to be stored in Flash Memory

native_db

Drop-in embedded database

process_mining

Process Mining library for working with (object-centric) event data

pciid-parser

parsing PCI ID tables

valor_kv

efficient key value store built with Rust

seshat

A matrix message logger with full text search support

dbutils

Utils for developing databases

rustdb

SQL database

pickledb

A lightweight and simple key-value store written in Rust, heavily inspired by Python's PickleDB (https://pythonhosted.org/pickleDB/)

mmkv

Rust version of MMKV

titanit

File share server for Titan protocol with Gemini frontend

surrealdb-nightly

A nightly release of the surrealdb crate

qubl-rs

Low level And flexible query builder that gives you full control of your queries

izihawa-tantivy

Search engine library

nomt

Nearly Optimal Merkle Trie - Schema and Database

terminus-store

a triple store library

lsm-tree

A K.I.S.S. implementation of log-structured merge trees (LSM-trees/LSMTs)

polars-pipe

Lazy query engine for the Polars DataFrame library

spark-connect-rs

Apache Spark Connect Client for Rust

rrd

Bindings to librrd to create and interact with round robin databases created with Tobias Oetiker's rrdtool (https://www.rrdtool.org/)

wild-doc-server

wild-doc server

vortex-scalar

Vortex Scalars

ekv

Key-value database for embedded systems, for raw NOR flash, using an LSM-Tree

sanakirja

Copy-on-write datastructures, storable on disk (or elsewhere) with a stable format

sulid

unique ID generation algorithm that combines the benefits of ULID and Snowflake

myval

Lightweight Apache Arrow data frame

nu_plugin_polars

Nushell dataframe plugin commands based on polars

datafusion-expr

Logical plan and expression representation for DataFusion query engine

tavily

A tiny tool for calling Tavily's REST API in the simplest way!

re_dataframe

High-level query APIs

cityhasher

A pure Rust implementation of Google's CityHash hashing algorithm

searchy

Search index (in-memory), that can be constructed and searched using a bag of words model, with cosine similarity scoring based on tf-idf. Supports multiple search terms, permissions…

simd-r-drive

SIMD-optimized append-only schema-less storage engine. Key-based binary storage in a single-file storage container.

arroyo-udf-common

Common utilities for the Arroyo UDF FFI API

parquet_aramid

Query engine using Parquet tables as a Key-Value store

sled-overlay

Overlay mechanism for sled

queued

Fast zero-configuration single-binary simple queue service

nakago

A lightweight Rust toolkit for sharp dependency injection 😎

redsumer

Lightweight implementation of Redis Streams for Rust

AliceDBMS

Alice-Database is a comprehensive data management solution designed to integrate seamlessly with the Kingdom System. This plugin provides robust functionality for creating, updating…

spacetimedb-primitives

Primitives such as TableId and ColumnIndexAttribute

rumdb

Blazing fast key-value storage basec on Bitcask whitepaper

furdb

A minimal Database Management System that prioritizes storage space usage and fast lookup/query times

nebari

ACID-compliant database storage implementation using an append-only file format

tinysearch

A tiny search engine for static websites

worterbuch-cluster-orchestrator

An orchestrator for running Wörterbuch as a distributed cluster

trivialdb

Rust bindings for the TDB database library

velarixdb

An LSM Storage Engine focused on reduced IO amplification

os-checker-database

The output transformer of os-checker CLI, used to generate static data for os-checker WebUI

shuttle-qdrant

Shuttle plugin for connecting to a Qdrant database

sst

sorted string table abstraction

zawgl-core

Zawgl Graph Core Library

redb-bincode

redb + bincode wrapper around redb

indradb

A graph database server

prefixed-tsid

Create Stripe-style prefixed database IDs that are type-safe and portable

airomem

persistence library inspired by Prevayler and @jarekratajski

libimagutil

imag core distribution

vortex-layout

Vortex layouts provide a way to perform lazy push-down scans over abstract storage

moiradb

An experimental deterministic database

notmuch

Rust interface and bindings for notmuch

mmdb

A std-collection-like database

struct_db

Drop-in embedded database

moogle

data structures for relational code

polars-rows-iter

easy and convenient row iteration of polars dataframes

eyros

multi-dimensional interval database

skipdb

An embedded, in-memory, zero-copy, atomicity, consistency, MVCC, almost lock-free and serializable snapshot isolation database engine

geoprox-client

An HTTP client library for interacting with the Geoprox search engine

bitask

Bitcask, a log-structured key-value store optimized for high-performance reads and writes

buffdb

Embedded storage at the speed of light

bbolt-rs

port of the Bolt database

vinculum

Lock-Free Deduplication in Rust

vortex-error

Vortex errors

polars-expr

Physical expression implementation of the Polars project

nut

Bolt DB Port in Rust

algoliasearch

Algolia client

tracksync

A command-line tool to manage music library syncing to neatly ordered directories

frugalos

Frugal Object Storage

vector

The package provides a vector database allowing for efficient search of nearest neighbors

anni-repo

Operate on anni metadata repository

dbml-rs

A DBML Parser for Rust

octosurfer

Search GitHub, clone matching repos, and search through the repos

datafrog

Lightweight Datalog engine intended to be embedded in other Rust programs

trs-dataframe

Dataframe library for Teiresias

ballista-executor

Ballista Distributed Compute - Executor

nu-cmd-dataframe

Nushell's dataframe commands based on polars

typed-sled

Sled with types instead of bytes

veresiye

Database

humus

A composting database. This is a small experiment in deliberate data decaay: A simple in-memory database that slowly forgets the things that you don't revisit.

kv

An embedded key/value store for Rust

noise_search

Nested Object Inverted Search Engine

tantivy-sstable

sstables for tantivy

tag_index

searchable index over key-value tags

disk-chan

An on-disk, (almost) lock-free, async, mpmc channel

aol

Generic purpose append only log implementation

microdb

A very small in-program database with cache, disk storage, etc

structsy

single file structs database

reasonable

An OWL 2 RL reasoner with reasonable performance

tectonicdb

server

xapian-rusty

Rust bindings to Xapian

tantivy-fst

tantivy-specific fork from the fst crate from Burntsushi. (Please use the fst crate instead.)

db-core

dbms engine

avlon-db

embedded struct database wrapper based on Sled

simplebase

database library

cannyls

Embedded persistent key-value storage optimized for random-access workload and huge-capacity HDD

bjsmiley-surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

mini-rag

100% Rust implementation of a vector storage database with on disk persistency

ghaladb

LSM tree based key value store with keys and values separation

sitewriter

A sitemap writing library

risinglight

An OLAP database system for educational purpose

vegafusion-dataframe

VegaFusion's DataFrame and Connection traits

rustque

fast on disk perstant memeory mapped que for rust it stores Vec<u8> to a file on a disk

sourisdb

Database format focused on compression size without using external libraries

tantivy-stacker

term hashmap used for indexing

flyway-sql-changelog

Flyway-rs project, Database change control,similar to flyway in Java

vectordb

LanceDB: A serverless, low-latency vector database for AI applications

simple_db

rust databasing crate for local file store

simple-triplestore

graph database for storing triples with support for custom node and edge properties

valor_kv_client

A client library for interacting with the valor_kv key-value store

xapian-rs

Rust bindings for the Xapian search engine

waffle-trie

Trie mapping for waffle

shortcut

an indexed, queryable column-based storage system

object-warehouse

A lightweight object storage database

tf-binding-rs

Fast transcription factor binding site prediction and FASTA manipulation in Rust

ayun-console

Framework for Web Rustceans

pallet

Document store built with sled and tantivy

doublets

Modular framework to automation by automation

qwal

A disk baced Write Ahead Log that can functuin as a FIFO queue

raindb

A persistent key-value store based on an LSM tree implemented in Rust

graphannis-webservice

web service to the new backend implementation of the ANNIS linguistic search and visualization system

langmore

A KV Store Based On Write-Ahead Log

re_view_dataframe

A view that shows the data contained in entities in a table

vortex-ipc

IPC message format to exchange Vortex arrays across processes

datafusion-functions-array

Array Function packages for the DataFusion query engine

vortex-bytebool

Vortex byte-boolean array

quotick

Embedded tick market data (trade, quote, ..) database storage optimized for billions of data points

re_data_store

An in-memory time series database for Rerun log data, based on Apache Arrow

findcar

An extensible CLI tool that filters, sorts, and aggregates search results from car websites. Because of course you want to search for cars from the command line.

tinkv

A fast and simple key-value storage engine

yakv

persistent key-value storage based on B-Tree

hkvdb

key-value store tracking historical information

simd-r-drive-extensions

Storage extensions for SIMD R Drive

pagecache

lock-free pagecache and log for high-performance databases

polars-mem-engine

In memory engine of the Polars project

alexandria

An encrypted document-oriented database with tag based query support

vortex-io

Core async and blocking IO traits and implementations, used by IPC and file format

kafka-to-worterbuch

Dump kafka topics into a Wörterbuch

ng-oxigraph

a SPARQL database and RDF toolkit. fork for NextGraph

paradedb-tantivy

Search engine library

summavy

Search engine library

orderwal

A generic-purpose, atomic, ordered, zero-copy read, zero-cost (in-place) write, Write-Ahead Log implementation for Rust

sorted_array

A sorted array data structure adapted from StackMap

tinybase

A tiny embedded database built in Rust

palletizer

self-hosted Cargo registry

izihawa-tantivy-tokenizer-api

Tokenizer API of tantivy

mtbl

Bindings to the MTBL C library (https://github.com/farsightsec/mtbl)

libimagstore

imag core distribution

summavy-common

common traits and utility functions used by multiple tantivy subcrates

izihawa-tantivy-query-grammar

Search engine library

sewup

help you sew up your Ethereum project with Rust and just like develop in a common backend

snapshotor

An abstraction layer of snapshot for developing multiple versions storage

black-jack

DataFrame / Series / general data processing in Rust

versatile-data

databases that has convenient datasets that group together commonly used fields and gives you the flexibility to create your own fields

froogle

A local Search Engine

quicksearch

Configurable quick search engine shortcuts

crepedb-redb

An versioned and forkable embedded Key-Value database

rsdb

a flash-sympathetic persistent lock-free B+ tree, pagecache, and log

codd

minimal in-memory database with relational algebraic expressions as queries

pingcap/linearizability

open source training courses about distributed database and distributed systems

imag

Part of the imag core distribution: imag command

libimagrt

imag core distribution

mvdb

Minimum Viable (Psuedo) Database

tantivy-uffd

Query a remote tantivy index with HTTP range requests

json_store

JSON STORE

pouch-server

A really tiny KV store

libimagerror

imag core distribution

schema_org_constants

Schema.org schemas as Rust constants

grebedb

Lightweight embedded key-value store/database backed by files in a virtual file system interface

readb

efficient, and modular embedded read-first key-value database in Rust

roogle-engine

API search engine

bloomur

Bloom filter for databases

EasyAlgolia

EasyAlgolia is a Rust crate designed for utilizing the Algolia admin client. It simplifies the process of updating and inserting documents into Algolia's search index.

qpml

Query Plan Markup Language (QPML)

wild-doc-webserver

still in development

mmdb-grpc

The gRPC service that provides a query to Maxmind's GeoLite2 databases

bonsaidb-client

Client for accessing BonsaiDb servers

leveldb-rs

Bindings to the LevelDB key/value storage library (https://github.com/google/leveldb)

reddb

Minimalistic in-memory embedded database with persistance

indradb-lib

A graph database library

polars-core

Core of the Polars DataFrame library

ejdb

Bindings for EJDB, and embedded JSON database

index

a flash-sympathetic persistent lock-free B+ tree

doc_store

document search by hnsw

solomondb

An embedded and distributed Gremlin-compatible graph database

caves

A collection of embedded, thread-safe key-value stores in Rust

imag-timetrack

Part of the imag core distribution: imag-timetrack command

csearch

Enter your query and it will be opened in browser

feophant

A SQL database server written in Rust and inspired by PostreSQL

alex-db-server

AlexDB server

libimagtimeui

imag core distribution

hive-mind

key-value database with easy struct support powered on sled

husky

creating databases like iterators

arroyo-udf-plugin

Plugin interface for Arroyo UDFs

disk-mpmc

on-disk mpmc

vec-embed-store

thin wrapper around LanceDb (VectorDb) meant to provide a means to create/store/query embeddings in a LanceDb without the need to grok the lower level Arrow/ColumnarDb tech

annis-web

experimental version of ANNIS corpus search frontend

nodb

A lightweight and simple key-value store written in Rust

polars-algo

Algorithms built upon Polars primitives

smolldb

small in-memory key-value database, which can be easly backed up in a file and later loaded from it

surrealdb-core-next

A next release of the surrealdb-core crate

dbeel

fast and minimal distributed thread-per-core document database

valog

A lock-free, generic, lightweight value log

vineyard-datafusion

Vineyard Rust SDK: arrow datafusion integration for DataFrame

imag-todo

Part of the imag core distribution: imag-todo command

libimagentrylist

imag core distribution

libimagentryutil

imag core distribution

bonsaidb-utils

used within BonsaiDb

scursor

Secure cursor library with support for read and write transactions

libimagentryfilter

imag core distribution

libimaginteraction

imag core distribution

migrations

A small library to handle migrations, with built in support for libsql

sqlo

Syntactic sugar for sqlx. Sqlo is another attempt to make a nice/pleasant API in Rust using relational database. Sqlo is built on top of sqlx and uses sqlx macros so you keep all the…

list-rs

cli todo app

libimagentryview

imag core distribution

libimagtimetrack

imag core distribution

bonsaidb-server

Database server for BonsaiDb

ntap-db-tcp-service

ntap-db-udp-service

surql-definition

procedural macro for generating SurrealDB table and field definitions

locustdb-compression-utils

compressing and decompressing sequences used in LocustDB

tantivy-columnar

column oriented storage for tantivy

spatial_table

Bi-directional association between entities and 2D grid locations

koala

Python's pandas implementation in Rust

summavy_codecs

Fast field codecs used by tantivy

mhdb

Pure rust embeddable key-value store database

libimagentrydatetime

imag core distribution

libimagentryref

imag core distribution

ruroonga_command

A tiny Groonga query builder and generator

libimagnotes

imag core distribution

libimagmail

imag core distribution

dtlog

A log for tracking discard stats of multi-files databases

tstorage

Embedded time-series database

libimagdiary

imag core distribution

surrealdb-core

A scalable, distributed, collaborative, document-graph database, for the realtime web

libimaghabit

imag core distribution

libimagentrytag

imag core distribution

vectorscan-async

Wrapper for the vectorscan C++ regex library

libimagentrymarkdown

imag core distribution

imag-store

Part of the imag core distribution: imag-store command

memorydb

in-memory implementation of hashdb

imag-diary

Part of the imag core distribution: imag-diary command

libimagtodo

imag core distribution

shared-ids

New types for different IDs

libimagentrycategory

imag core distribution

libimagcontact

imag core distribution

waxy

web crawler for community driven search engine

sparkv

Expirable in-memory key-value store

imag-ref

Part of the imag core distribution: imag-ref command

libimagentryedit

imag core distribution

libimagbookmark

imag core distribution

imag-init

Part of the imag core distribution: imag-init command

brassfibre

multiple-dtype columner storage, known as DataFrame in pandas/R

koit

asynchronous, pure-Rust, structured, embedded database

macrodb

Macro-generated in-memory relational database for Rust

imag-grep

Part of the imag core distribution: imag-grep command

ampiato

🧮 The Rust Powerplant Scheduling Toolkit. A Rust crate to build a great powerplant optimization and scheduling software. Automatic database migrations, consistent code and schema…

sdb

a user-friendly wrapper for sanakirja database

prevayler-rs

System prevalence in rust

wired

WIP: Collection of embeddable database models for Rust

imag-gps

Part of the imag core distribution: imag-gps command

pstream

A persistent byte stream over block storage

imag-mv

Part of the imag core distribution: imag-mv command

imag-tag

Part of the imag core distribution: imag-tag command

libimagwiki

imag core distribution

tantivy-ik

chinese segment, ik-rs for tantivy

imag-notes

Part of the imag core distribution: imag-notes command

imag-view

Part of the imag core distribution: imag-view command

roo_engine

Roo is a smart bookmarking and productivity tool that works as a custom search engine for your browser

imag-bookmark

Part of the imag core distribution: imag-bookmark command

libimagentryannotation

imag core distribution

imag-edit

Part of the imag core distribution: imag-edit command

typedb

persistent generic HashMap/Key-value store

imag-mail

Part of the imag core distribution: imag-mail command

libimagentrygps

imag core distribution

imag-habit

Part of the imag core distribution: imag-habit command

vortex-array

Vortex in memory columnar data format

imag-log

Part of the imag core distribution: imag-log command

libimagnotification

imag core distribution

imag-annotate

Part of the imag core distribution: imag-annotate command

cube-query

querying the CubeMX database

datafusion-physical-expr-common

Common functionality of physical expression for DataFusion query engine

dwal

A KV Store Based On Write-Ahead Log

imag-ids

Part of the imag core distribution: imag-ids command

imag-diagnostics

Part of the imag core distribution: imag-diagnostics command

vortex-dict

Vortex dictionary array

background-jobs-sled-storage

Sled storage backend for background-jobs

binstore

key-value store written in Rust. Uses its own compact file format.

filter_ast

An AST for boolean filter expressions

imag-category

Part of the imag core distribution: imag-category command

bincode-sled

Sled with types instead of bytes. Powered by bincode-v2

imag-wiki

Part of the imag core distribution: imag-wiki command

libimaglog

imag core distribution

neighbor

content management system

fs2db

migration helper

bitcasky-common

Common part for bitcasky lib

simple-raft

A minimal implementation of the Raft consensus algorithm

sled-native

a C-compatible API for sled

camelliakv

Embedded persistent key-value storage optimized for random-access workload and huge-capacity HDD

libdb

statically linked rust bindings for Berkeley DB

arroyo

distributed stream processor that lets users ask complex questions of high-volume real-time data by writing SQL. This CLI can be used to run Arroyo clusters in Docker

imag-counter

Part of the imag core distribution: imag-counter command

local-jcs-store

Store a directory of JSON objects, indexed by a cannonical hash

filedb-ng

Database that's using files to store data. See documetation for more information

polygraph

A multiple-interconnected graph library or in-memory relational database

tavlars

Tabular data processing for humans

ancla

command line tool of golang's bolt database

perlin

A lazy, zero-allocation and data-agnostic Information Retrieval library

vortex-proto

Protocol buffer definitions for Vortex types

koit-toml

asynchronous, pure-Rust, structured, embedded database

unobtanium-crawler

The default web-crawler for unobtanium

vortex-alp

Vortex ALP array

rebacdb

A relationship-based access control database inspired by google zanzibar

tigers

DataFrame library for Rust, inspired by Pandas

daybreak

A modular and configurable database, continuation of the Rustbreak project

reindexer-rs

Reindexer library for Rust

poke-engine

A Pokemon battle engine that can be used to search through the state space of a Pokemon battle

polars-stream

Private crate for the streaming execution engine for the Polars DataFrame library

summavy-query-grammar

Search engine library

vortex-runend

Vortex run end encoded array

vortex-datetime-parts

Vortex physical encoding that compresses temporal components individually

vortex-mask

Vortex Mask - sorted, unique, non-negative integers

rucksack-db

The rucksack encrypted database

mintdb

open source document based database built in Rust

vortex-tui

a small but might tool for working with Vortex files

lsmdb

efficient storage engine that implements the Log-Structured Merge Tree (LSM-Tree) data structure, designed specifically for handling key-value pairs

vortex

file format with all builtin codecs and a sampling compressor

tqdb

Tiny Query Database (TQDB) is a small library for creating a query-able database that is encoded with json

edma_storage

EDMA: Embedded Database Management for All

rsi

A lightweight RSI library in Rust

find-places-db

Quick and dirty crate for finding a user's local places databases

vortex-datafusion

Apache Datafusion integration for Vortex

arrow_util

Tools for Apache Arrow

libimagentryurl

imag core distribution

constdb

fast read-only embedded key value datastore

click7

website click counter with 7 segment display

libimagcalendar

imag core distribution

imag-create

Part of the imag core distribution: imag-diagnostics command

imag-markdown

Part of the imag core distribution: imag-markdown command

vortex-buffer

A byte buffer implementation for Vortex

MMDB_Server

{InDev} A simple,easy to use database server

imag-id-in-collection

Part of the imag core distribution: imag-ids command

append-log

Append-only log for fail-safe backups

imag-header

Part of the imag core distribution: imag-header command

dinglebit-store

simplified storage interface

imag-calendar

Part of the imag core distribution: imag-calendar command

structsy_tools

Tools for structsy embedded dbms

datastore

A generic store wrapper

vortex-btrblocks

BtrBlocks style compressor

vortex-dtype

Vortex's core type system

vortex-sparse

Vortex Sparse array

fcs_rs

Basic tool for manipulating and analyzing Flow Cytometry Standard (FCS) files

redrust

port of the popular Redis database system written in Rust programming language. This port aims to provide all the features of Redis while taking advantage of the Rust language's safety…

datafusion-functions-window

Window function packages for the DataFusion query engine

vortex-roaring

Vortex roaring bitmap arrays

lrdf

Commandline tool to generate a dataframe from Oxford Nanopore FastQ

vortex-fsst

Vortex FSST string array encoding

imag-contact

Part of the imag core distribution: imag-contact command

vortex-runend-bool

Vortex run end encoded boolean array, strictly better than runend for bool arrays

inv

Command Line Inventory Manager. Prevent food waste and never lose track of your items!

vortex-flatbuffers

Flatbuffers definitions for Vortex types

vortex-sampling-compressor

Vortex compressor that uses statistical sampling

crabfish

chess engine

minigre_base

text file search tool

libimagcounter

imag core distribution

vortex-expr

Vortex Expressions

unobtanium

Opinioated Web search engine library with crawler and viewer companion

solrs

A Solr client for Rust

vortex-zigzag

Vortex zig zag array