serde-intermediate

serde-intermediate

Intermediate representation for Rust's Serde serialization

Table of contents

1. Goals
2. Installation
3. Examples

Goals

This crate was made to solve these particular problems:

• Provide untyped (obviously "fat") runtime value representation used as exchange data ready to be deserialized on demand into typed data, for data where serializable tagged trait objects don't work on taret platforms.

  Example: data stored in interpreted language runtime value.

• Support for more interpreted than exact data conversion (if it quacks like a duck, treat it like a duck) which is default behavior, optionally force to read exact layout stored in value.

  Example: more forgiving convertion between unrelated data formats.

• Support for versioning (allow to produce diffs between two versions of data, that can be later patched on demand).

  Example: Game assets content difference for DLC or any episodic content usage; editor UI sending only changes to the game runtime to patch what actually changed in the world (instead of sending entire serialized object state).

• Support for tagged intermediate data.

  Example: Game asset stores data of type that is decided at runtime (associated tag gives hint what type its layout represents).

Installation

1. Core crate with most important Intermediate and ReflectIntermediate types:

   [dependencies]
   serde-intermediate = "*"
   

   If you prefer to compile without ReflectIntermediate derive macro (derive feature adds derive macros and is enabled by default):

   [dependencies]
   serde-intermediate = { version = "*", default-features = false }
   

2. Crate that adds support for tagged intermediate value (to embed tagged Intermediate in other serializable data with TaggedIntermediate type):

   [dependencies]
   serde-tagged-intermediate = "*"
   

   Same as with core crate, you can exclude ReflectIntermediate from compilation:

   [dependencies]
   serde-tagged-intermediate = { version = "*", default-features = false }
   

Examples

Serialize/deserialize:

use std::time::SystemTime;
use serde::{Serialize, Deserialize};

#[derive(Debug, PartialEq, Serialize, Deserialize)]
enum Login {
    Email(String),
    SocialMedia{
        service: String,
        token: String,
        last_login: Option<SystemTime>,
    }
}

#[derive(Debug, PartialEq, Serialize, Deserialize)]
struct Person {
    // (first name, last name)
    name: (String, String),
    age: usize,
    login: Login,
}

let data = Person {
    name: ("John".to_owned(), "Smith".to_owned()),
    age: 40,
    login: Login::Email("john.smith@gmail.com".to_owned()),
};
let serialized = serde_intermediate::to_intermediate(&data).unwrap();
let deserialized = serde_intermediate::from_intermediate(&serialized).unwrap();
assert_eq!(data, deserialized);

More elaborate problems and solutions:

1. Versioning (diff/patch) (test_versioning)
2. Conversion between data layouts (test_transform)
3. DLC / episodic content (test_dlcs)
4. Data change communication between game and editor (test_editor_communication)

License: MIT OR Apache-2.0