#buffer #toolkit #reserved #field #within #was #prototcol

prototk

prototk provides a toolkit for prototcol buffers

8 releases (5 breaking)

0.6.0 Feb 19, 2024
0.5.0 Dec 27, 2023
0.4.0 Sep 21, 2023
0.3.0 Sep 7, 2023
0.1.0 Apr 5, 2023

#402 in Encoding

Download history 3/week @ 2024-01-19 1/week @ 2024-01-26 1/week @ 2024-02-02 11/week @ 2024-02-09 125/week @ 2024-02-16 152/week @ 2024-02-23 57/week @ 2024-03-01 44/week @ 2024-03-08 34/week @ 2024-03-15 58/week @ 2024-03-22 90/week @ 2024-03-29 23/week @ 2024-04-05 26/week @ 2024-04-12 26/week @ 2024-04-19 30/week @ 2024-04-26 20/week @ 2024-05-03

107 downloads per month
Used in 20 crates (19 directly)

Apache-2.0

155KB
4K SLoC

prototk

prototk provides a toolkit for prototcol buffers.

Status

Maintenance track. The library is considered stable and will be put into maintenance mode if unchanged for one year. The clock was last reset 2023-09-19.

Scope

This library is about serialization and deserialization of messages. It strives to distil protocol buffers to this:

#[derive(Debug, Default, Message)]
pub enum Error {
    #[prototk(278528, message)]
    #[default]
    Success {
        #[prototk(1, message)]
        core: ErrorCore,
    },
    #[prototk(278529, message)]
    SerializationError {
        #[prototk(1, message)]
        core: ErrorCore,
        #[prototk(2, message)]
        err: prototk::Error,
        #[prototk(3, string)]
        context: String,
    },
    #[prototk(278530, message)]
    UnknownServerName {
        #[prototk(1, message)]
        core: ErrorCore,
        #[prototk(2, string)]
        name: String,
    },
    #[prototk(278531, message)]
    UnknownMethodName {
        #[prototk(1, message)]
        core: ErrorCore,
        #[prototk(2, string)]
        name: String,
    },
    #[prototk(278532, message)]
    RequestTooLarge {
        #[prototk(1, message)]
        core: ErrorCore,
        #[prototk(2, uint64)]
        size: u64,
    },
}

// serialize
let err = Error::UnknownServerName {
    core: ErrorCore::new("robert@rescrv.net", "unknown server name", &UNKOWN_SERVER_NAME_COUNTER),
    name: "FooRpcServer",
};
let buf = stack_pack(err).to_vec()

// deserialize
let up = Unpacker::new(&buf);
let err: Error = up.unpack()?;

Warts

  • The derive macro's errors are not the most easy to understand.

Reserved Field Ranges

The error types in my libraries all have diffrent field numbers. Here is where I track them.

  • 262144..262400 prototk::Error
  • 278528..278784 rpc_pb::Error
  • 294912..295168 macarunes::Error
  • 311296..311552 tuple_key::Error
  • 376832..377088 mani::Error
  • 442368..442624 sst::Error
  • 507904..508160 protoql::Error
  • 573440..573696 paxos_pb::Error

Maps

Maps are not supported by prototk natively because the typing is too complicated. Make a MapEntry type that has field number 1 for the key and 2 for the value. Put it in a Vec tagged as a message.

Documentation

The latest documentation is always available at docs.rs.

Dependencies

~1.5MB
~34K SLoC