11 releases

0.4.3+0.34.0 Jan 9, 2025
0.4.2+0.34.0 May 13, 2024
0.3.4+0.34.0 Mar 22, 2024
0.3.3+0.34.0 Feb 28, 2024
0.2.8-alpha Sep 26, 2022

#370 in Simulation

Download history 692/week @ 2024-10-30 514/week @ 2024-11-06 613/week @ 2024-11-13 986/week @ 2024-11-20 771/week @ 2024-11-27 710/week @ 2024-12-04 614/week @ 2024-12-11 741/week @ 2024-12-18 548/week @ 2024-12-25 746/week @ 2025-01-01 810/week @ 2025-01-08 631/week @ 2025-01-15 700/week @ 2025-01-22 404/week @ 2025-01-29 860/week @ 2025-02-05 648/week @ 2025-02-12

2,785 downloads per month

Apache-2.0

515KB
10K SLoC

madsim-rdkafka

Crate Docs

The rdkafka simulator on madsim. Mirrors rdkafka v0.34.0 and librdkafka 2.3.0.

Usage

Replace all rdkafka entries in your Cargo.toml:

[dependencies]
rdkafka = { version = "0.4", package = "madsim-rdkafka" }

API Modification

This crate roughly follows the rdkafka API but is NOT exactly the same.

The following functions are modified to be async:

  • FromClientConfig::from_config
  • FromClientConfigAndContext::from_config_and_context
  • ClientConfig::create
  • ClientConfig::create_with_context
  • Client::fetch_metadata[^1]
  • Client::fetch_watermarks[^1]
  • Client::fetch_group_list[^1]
  • Consumer::seek
  • Consumer::seek_partitions
  • Consumer::commit
  • Consumer::commit_consumer_state
  • Consumer::commit_message
  • Consumer::committed
  • Consumer::committed_offsets
  • Consumer::offsets_for_timestamp
  • Consumer::offsets_for_times[^1]
  • Consumer::fetch_metadata[^1]
  • Consumer::fetch_watermarks[^1]
  • Consumer::fetch_group_list[^1]
  • Producer::flush
  • Producer::init_transactions
  • Producer::send_offsets_to_transaction
  • Producer::commit_transaction
  • Producer::abort_transaction

[^1]: wrapped in tokio::task::spawn_blocking

The associated constant ClientContext::ENABLE_REFRESH_OAUTH_TOKEN is changed to a function in order to make the trait object-safe.

DNS Resolution

This crate has cherry-picked a commit from Materialize to support rewriting broker addresses.

A new method is added to ClientContext:

  • ClientContext::rewrite_broker_addr

Dependencies

~13–28MB
~382K SLoC