#serialization #database #content-addressable #break #store #values #stored

casserole

Break and serialize values into content-addressable storage

2 unstable releases

0.2.0 Aug 4, 2021
0.1.0 Jul 20, 2021

#1072 in Encoding

Download history 77/week @ 2023-12-18 38/week @ 2024-01-01 21/week @ 2024-01-08 34/week @ 2024-01-15 71/week @ 2024-01-22 84/week @ 2024-01-29 75/week @ 2024-02-05 82/week @ 2024-02-12 77/week @ 2024-02-19 71/week @ 2024-02-26 121/week @ 2024-03-04 134/week @ 2024-03-11 129/week @ 2024-03-18 64/week @ 2024-03-25 121/week @ 2024-04-01

454 downloads per month

MIT/Apache

19KB
351 lines

The casserole crate provides a custom derive and a trait to perform break-down serialization and de-serialization of Rust types into stores.

The most common use case is to break down large objects to be stored in content-addressable storage, like in a Git database. Hence the name 'CAS-ser-role'.

The trait which Casserole auto-derives generates smaller types that contain references to keys instead of the original data. For example HashMap<String, BigValue> is replaced with HashMap<String, S::Key> where S is a type parameter to a user-provided storage engine. In addition, fields on which the store attribute is given e.g. #[casserole(store)], are also replaced with S::Key.

For example:

/// Example Tree to be stored in the database
#[derive(Casserole)]
struct Node {
    header: String,

    // Tells that 'map' is replaced by a database key in the type returned from
    // the 'casserole' trait method. The 'decasserole' trait method will do the
    // reverse, restoring it from the database.
    #[casserole(store)]
    map: BTreeMap<String, Node>,
}

Basic usage demonstration (given big_value as a large value to work with):

// Create a our serde-ready type for the root. `stored_root` is our unique
// representation for `big_value`, but it is very small, like a Git hash.
let stored_root = big_value.casserole(&mut store).unwrap();

// <...do other stuff...>

// Restore the origin value from the database
let restored_big_value = Casserole::decasserole(&stored, &mut store).unwrap();
assert_eq!(restored_big_value, big_value);

Dependencies

~0.5–2.2MB
~39K SLoC