#lsm-tree #persistence #bindings #embedded

rust-rocksdb

Rust wrapper for Facebook's RocksDB embeddable database

13 releases (4 breaking)

new 0.26.0 May 24, 2024
0.25.0 Apr 23, 2024
0.24.0 Apr 19, 2024
0.23.2 Mar 30, 2024
0.22.6 Feb 28, 2024

#3 in #lsm-tree

Download history 110/week @ 2024-02-09 260/week @ 2024-02-16 396/week @ 2024-02-23 328/week @ 2024-03-01 234/week @ 2024-03-08 407/week @ 2024-03-15 284/week @ 2024-03-22 413/week @ 2024-03-29 155/week @ 2024-04-05 111/week @ 2024-04-12 597/week @ 2024-04-19 331/week @ 2024-04-26 228/week @ 2024-05-03 99/week @ 2024-05-10 131/week @ 2024-05-17

908 downloads per month

Apache-2.0

22MB
462K SLoC

C++ 393K SLoC // 0.1% comments Java 43K SLoC // 0.3% comments Rust 9K SLoC // 0.1% comments Python 8K SLoC // 0.1% comments Shell 4K SLoC // 0.2% comments C 3K SLoC // 0.0% comments GNU Style Assembly 542 SLoC // 0.1% comments INI 323 SLoC // 0.1% comments PowerShell 312 SLoC // 0.2% comments Bitbake 167 SLoC // 0.2% comments Bazel 100 SLoC // 0.5% comments

rust-rocksdb

RocksDB build crates.io documentation license rust 1.75.0 required

GitHub commits (since latest release)

Why The Fork

The original rust-rocksdb repo is amazing and I appreciate all the work that has been done, however, for my use case, I need to stay up to date with the latest rocksdb releases as well as the latest rust releases so in order to to keep everything up to date, I decided to fork the original repo so I can have total control and be able to create regular releases.

Requirements

  • Clang and LLVM

Contributing

Feedback and pull requests welcome! If a particular feature of RocksDB is important to you, please let me know by opening an issue, and I'll prioritize it.

Usage

This binding is statically linked with a specific version of RocksDB. If you want to build it yourself, make sure you've also cloned the RocksDB and compression submodules:

git submodule update --init --recursive

Features

Compression Support

By default, support for Snappy, LZ4, Zstd, Zlib, and Bzip2 compression is enabled through crate features. If support for all of these compression algorithms is not needed, default features can be disabled and specific compression algorithms can be enabled. For example, to enable only LZ4 compression support, make these changes to your Cargo.toml:

[dependencies.rocksdb]
default-features = false
features = ["lz4"]

Multithreaded ColumnFamily alternation

RocksDB allows column families to be created and dropped from multiple threads concurrently, but this crate doesn't allow it by default for compatibility. If you need to modify column families concurrently, enable the crate feature multi-threaded-cf, which makes this binding's data structures use RwLock by default. Alternatively, you can directly create DBWithThreadMode<MultiThreaded> without enabling the crate feature.

Switch between /MT or /MD run time library (Only for Windows)

The feature mt_static will request the library to be built with /MT flag, which results in library using the static version of the run-time library. This can be useful in case there's a conflict in the dependecy tree between different run-time versions.

Jemalloc

The feature jemalloc will enable the unprefixed_malloc_on_supported_platforms feature of tikv-jemalloc-sys, hooking the actual malloc and free, so jemalloc is used to allocate memory. On Supported platforms such as Linux, Rocksdb will also be properly informed that Jemalloc is enabled so that it can apply internal optimizations gated behind Jemalloc being enabled. On unsupported platforms, Rocksdb won't be properly informed that Jemalloc is being used so some internal optimizations are skipped BUT you will still get the benefits of Jemalloc memory allocation. Note that by default, Rust uses libc malloc on Linux which is known to have more memory fragmentation than Jemalloc especially with Rocksdb. See github issue for more information. In general, I highly suggest enabling Jemalloc unless there is a specific reason not to (your system doesn't support it, etc.)

Malloc Usable Size

The feature malloc-usable-size will inform Rocksdb that malloc_usable_size is supported by the platform and is necessary if you want to use the optimize_filters_for_memory rocksdb feature as this feature is gated behind malloc_usable_size being available. See rocksdb for more information on the feature.

Dependencies

~0.3–4.5MB
~79K SLoC