#serialization #database #storage #break #content-addressable #derive #casserole

macro casserole-derive

Break and serialize values into content-addressable storage

2 unstable releases

0.2.0 Aug 4, 2021
0.1.0 Jul 20, 2021

#19 in #content-addressable

Download history 89/week @ 2023-11-19 177/week @ 2023-11-26 49/week @ 2023-12-03 100/week @ 2023-12-10 83/week @ 2023-12-17 38/week @ 2023-12-31 23/week @ 2024-01-07 39/week @ 2024-01-14 73/week @ 2024-01-21 80/week @ 2024-01-28 81/week @ 2024-02-04 86/week @ 2024-02-11 81/week @ 2024-02-18 70/week @ 2024-02-25 119/week @ 2024-03-03

358 downloads per month
Used in casserole

MIT/Apache

25KB
564 lines

The casserole crate provides a custom derive and a trait to perform break-down serialization and de-serialization of Rust types into stores.

The most common use case is to break down large objects to be stored in content-addressable storage, like in a Git database. Hence the name 'CAS-ser-role'.

The trait which Casserole auto-derives generates smaller types that contain references to keys instead of the original data. For example HashMap<String, BigValue> is replaced with HashMap<String, S::Key> where S is a type parameter to a user-provided storage engine. In addition, fields on which the store attribute is given e.g. #[casserole(store)], are also replaced with S::Key.

For example:

/// Example Tree to be stored in the database
#[derive(Casserole)]
struct Node {
    header: String,

    // Tells that 'map' is replaced by a database key in the type returned from
    // the 'casserole' trait method. The 'decasserole' trait method will do the
    // reverse, restoring it from the database.
    #[casserole(store)]
    map: BTreeMap<String, Node>,
}

Basic usage demonstration (given big_value as a large value to work with):

// Create a our serde-ready type for the root. `stored_root` is our unique
// representation for `big_value`, but it is very small, like a Git hash.
let stored_root = big_value.casserole(&mut store).unwrap();

// <...do other stuff...>

// Restore the origin value from the database
let restored_big_value = Casserole::decasserole(&stored, &mut store).unwrap();
assert_eq!(restored_big_value, big_value);

Dependencies

~1.5MB
~34K SLoC