Hakuban

Convenient data-object sharing library.

Are you tired of handling all the little details of propagating object states? Computing differences, serialization, network propagation (timeouts, keep-alives, ...), somehow catching-up on reconnection, load balancing object production, event delivery, object lifetime control etc. Hakuban does all of that for you.

For details on structs, modules, cargo feature flags, event handling, etc. head on to documentation.

If you feel you may need something slightly different, there is a list of similar projects at the end of this document.

Features

Some of Hakuban's features and properties:

• Only the difference is propagated over the network when an object changes. Compressed by default.
• Automatically handles re-synchronization on connection loss and regain.
• Object identifiers are "rich" (json), not just strings. So, for example, complex user-defined search filter on a web page, expressed as json, can directly act as an identifier of the object holding results of that search.
• Object can belong to zero or more tags, which function as wildcards for exposing or observing unknown objects.
• Supports tree network topology, with leafs happily unaware of anything not relevant to them.
• Exchanges on all levels can observe and expose alike, unlike in most database/graphql-centric solutions.
• At most one exposer is selected for each object to keep it up to date. With load balancing.
• Thread-safe core, delivers data with streams, accepts data with sinks.
• Core is not bound to any specific async-runtime. First implemented network transport uses websockets on tokio.
• Allows use of custom de/serializers, uses serde by default.
• Can be compiled to .so, has ruby binding (ffi), and wasm/js binding.

It's not meant for and won't do: message passing, remote function calls, synchronous "calls" (request-response), allow explicit target addressing, be a work-queue, allow "consuming" objects, work directly with any database, modify objects in transit.

Usage example

let exchange = Exchange::new();

let mut observe_contract = exchange.object_observe_contract((["some-tag"],"xxx")).build();
let mut expose_contract = exchange.object_expose_contract((["some-tag"],"xxx")).build();

tokio::spawn(async move {
	//ExposeContract emits ObjectStateSink when first observer appears
	let mut object_state_sink = expose_contract.next().await.unwrap();
	let object_state = ObjectState::new("my data").json_serialize();
	object_state_sink.send(object_state).await;
});

tokio::spawn(async move {
	//ObserveContract emits ObjectStateStream
	let mut object_state_stream = observe_contract.next().await.unwrap();
	let object_state = object_state_stream.next().await.unwrap().json_deserialize::<String>();
	println!("{:?}", object_state.data);
});

For more examples check out the examples directory, and documentation.

Related projects

Ruby binding

Hakuban ruby ffi binding.

Wasm/JS for browser

Hakuban compiled to wasm, with JS interface to use in browser.

Hakuban webapp state manager

(TODO: add url)

Webapp state manager, with:

• Every link being open-in-new-tab compatible, and copy-link compatible
• Short urls, optionally exposing selected state variables
• All urls (== application states) are shareable
• State can be bigger than what fits in a url (as long as it's built progresively)
• Works while offline/disconnected (no url shortening then)

Schedy

(TODO: add url)

Task queue/scheduler. Aware of resource preparation time. Resources owned and resources required by task are graph-structured.

MechaTouch

(TODO: add url)

Commercial (aka. shameless plug) robotic ui-testing platform.

Roadmap

Not ordered by priority:

• actor-ish api. allowing registration of object-producing lambdas, to be instantiated on demand in separate tasks.
• object signing, and access tokens
• preloading/side loading
• immunity to broken/malicious diffs
• expose more introspection/statistics objects
• lazy serialize/deserialize

License

Distributed under the MIT License. See LICENSE for more information.

Contact

To get help, praise the author(s), laugh at problems of others, or just hang around observing progress - join hakuban's matrix channel #hakuban:matrix.org

If you're looking for more intimate contact, talk to yunta - on matrix @yunta:mikoton.com, or email yunta@mikoton.com.

Similar projects

The list does not contain change- or message- focused projects, nor projects with integrated database. Hopefully. It's surprisingly difficult to figure out what some of those actually do:

• Redis
• Ably
• Fluvio
• deepstream
• nhost
• zenoh
• just diffing, if you don't need the network and lifetime control parts:
  • serde-diff
  • dipa
  • deltoid