#serialization #database #content-addressable #break #store #values #stored

casserole

Break and serialize values into content-addressable storage

2 unstable releases

0.2.0 Aug 4, 2021
0.1.0 Jul 20, 2021

#1300 in Encoding

Download history 90/week @ 2024-07-21 108/week @ 2024-07-28 84/week @ 2024-08-04 94/week @ 2024-08-11 135/week @ 2024-08-18 171/week @ 2024-08-25 65/week @ 2024-09-01 95/week @ 2024-09-08 105/week @ 2024-09-15 156/week @ 2024-09-22 333/week @ 2024-09-29 163/week @ 2024-10-06 137/week @ 2024-10-13 174/week @ 2024-10-20 141/week @ 2024-10-27 73/week @ 2024-11-03

534 downloads per month

MIT/Apache

19KB
351 lines

The casserole crate provides a custom derive and a trait to perform break-down serialization and de-serialization of Rust types into stores.

The most common use case is to break down large objects to be stored in content-addressable storage, like in a Git database. Hence the name 'CAS-ser-role'.

The trait which Casserole auto-derives generates smaller types that contain references to keys instead of the original data. For example HashMap<String, BigValue> is replaced with HashMap<String, S::Key> where S is a type parameter to a user-provided storage engine. In addition, fields on which the store attribute is given e.g. #[casserole(store)], are also replaced with S::Key.

For example:

/// Example Tree to be stored in the database
#[derive(Casserole)]
struct Node {
    header: String,

    // Tells that 'map' is replaced by a database key in the type returned from
    // the 'casserole' trait method. The 'decasserole' trait method will do the
    // reverse, restoring it from the database.
    #[casserole(store)]
    map: BTreeMap<String, Node>,
}

Basic usage demonstration (given big_value as a large value to work with):

// Create a our serde-ready type for the root. `stored_root` is our unique
// representation for `big_value`, but it is very small, like a Git hash.
let stored_root = big_value.casserole(&mut store).unwrap();

// <...do other stuff...>

// Restore the origin value from the database
let restored_big_value = Casserole::decasserole(&stored, &mut store).unwrap();
assert_eq!(restored_big_value, big_value);

Dependencies

~0.4–2.2MB
~38K SLoC