twitter_snowflake

A lightweight, efficient library that implements Twitter's Snowflake algorithm

1 stable release

1.0.0 Sep 8, 2024

#513 in Algorithms

Download history 152/week @ 2024-09-05 29/week @ 2024-09-12 13/week @ 2024-09-19 10/week @ 2024-09-26 7/week @ 2024-10-03

61 downloads per month

MIT license

17KB
163 lines

❄️ Snowflake

Snowflake is a lightweight, efficient Rust library that implements Twitter's Snowflake algorithm for generating unique, time-based IDs. Designed for distributed systems, it provides a scalable solution to ID generation, ensuring no collisions even across multiple workers. Perfect for building high-throughput, reliable systems.

📚 Features

  • Unique IDs: Generates 64-bit unique, time-based IDs.
  • High Scalability: Designed for distributed systems with multiple workers.
  • Efficient: Low-latency ID generation with no contention.
  • Customizable: Easy to tweak the bit allocation (worker ID, sequence).
  • Rusty: Written in pure Rust for performance and safety.

📐 How It Works

https://en.wikipedia.org/wiki/Snowflake_ID

The Snowflake algorithm generates IDs based on:

  • Timestamp (41 bits) - Time in milliseconds since a custom epoch.
  • Worker ID (10 bits) - A unique identifier for the worker.
  • Sequence (12 bits) - A per-worker counter that resets every millisecond.

The default bit allocation follows the original Snowflake design but can be customized for your specific needs.

🚀 Usage

Add Snowflake to your Cargo.toml:

[dependencies]
twitter_snowflake = "1.0.0"

Then, import it in your Rust code:

use {std::error::Error, twitter_snowflake::Snowflake};

fn main() -> Result<(), Box<dyn Error>> {
    let worker_id = 1;
    let mut snowflake = Snowflake::new(worker_id)?;
    let sfid = snowflake.generate()?;
    println!("Snowflake ID: {}", sfid);

    Ok(())
}

Custom Config

You can also set a custom config for ID generation:

use {std::error::Error, twitter_snowflake::Snowflake};

fn main() -> Result<(), Box<dyn Error>> {
    let worker_id = 1;
    let worker_id_bits = 4;
    let epoch: u64 = 1609459200000; // 2021-01-01 00:00:00.000 UTC

    let mut snowflake = Snowflake::builder()
        .with_worker_id_bits(worker_id_bits)
        .with_worker_id(worker_id)
        .with_epoch(epoch)
        .build()?;

    let sfid = snowflake.generate()?;
    println!("Snowflake ID: {}", sfid);
    Ok(())
}

See all examples.

🧪 Running Tests

To run the test suite, use:

cargo test

Benchmark

  • Rust version: rustc 1.79.0-nightly (dbce3b43b 2024-04-20)
  • Machine setup: Apple M1 Pro 3.23GHz CPU 32GB RAM
test bench_builder  ... bench:          26 ns/iter (+/- 1)
test bench_generate ... bench:         233 ns/iter (+/- 29)
test bench_new      ... bench:          26 ns/iter (+/- 0)

🤝 Contributing

Contributions are welcome! Feel free to submit issues, feature requests, or pull requests.

📄 License

Snowflake is licensed under the MIT License. See the LICENSE file for more details.

Dependencies

~275–730KB
~17K SLoC