#range #blake3 #hashing #streaming #chunk #tree #outboard

bao-tree

BLAKE3 verfiied streaming with custom chunk groups and range set queries

36 releases (12 breaking)

0.13.0 Apr 10, 2024
0.11.1 Mar 23, 2024
0.9.1 Sep 28, 2023
0.5.3 Jul 31, 2023
0.1.5 Mar 31, 2023

#231 in Data structures

Download history 116/week @ 2023-12-23 233/week @ 2023-12-30 314/week @ 2024-01-06 368/week @ 2024-01-13 825/week @ 2024-01-20 840/week @ 2024-01-27 872/week @ 2024-02-03 781/week @ 2024-02-10 794/week @ 2024-02-17 843/week @ 2024-02-24 1045/week @ 2024-03-02 1206/week @ 2024-03-09 1298/week @ 2024-03-16 1421/week @ 2024-03-23 1225/week @ 2024-03-30 1441/week @ 2024-04-06

5,613 downloads per month
Used in 6 crates (4 directly)

MIT/Apache

255KB
5.5K SLoC

bao-tree

Actions Status docs.rs crates.io

The merkle tree used for BLAKE3 verified streaming.

This is a slightly different take on blake3 verified streaming than the bao crate.

The network wire format for encoded data and slices is compatible with the bao crate, except that this crate has builtin support for runtime configurable chunk groups.

It also allows encoding not just single ranges but sets of non-overlapping ranges. E.g. you can ask for bytes [0..1000,5000..6000] in a single query.

The intention is also to support both sync and async en/decoding out of the box with maximum code sharing.

It allows to define both pre- and post order outboard formats as well as custom outboard formats. Post order outboard formats have advantages for synchronizing append only files.

For more detailed info, see the docs

Dependencies

~2.6–3.5MB
~71K SLoC