11 releases

new 0.4.3+0.34.0 Jan 9, 2025
0.4.2+0.34.0 May 13, 2024
0.3.4+0.34.0 Mar 22, 2024
0.3.3+0.34.0 Feb 28, 2024
0.2.8-alpha Sep 26, 2022

#401 in Asynchronous

Download history 1126/week @ 2024-09-20 615/week @ 2024-09-27 525/week @ 2024-10-04 1154/week @ 2024-10-11 815/week @ 2024-10-18 703/week @ 2024-10-25 606/week @ 2024-11-01 587/week @ 2024-11-08 851/week @ 2024-11-15 888/week @ 2024-11-22 761/week @ 2024-11-29 697/week @ 2024-12-06 574/week @ 2024-12-13 601/week @ 2024-12-20 637/week @ 2024-12-27 791/week @ 2025-01-03

2,750 downloads per month

Apache-2.0

515KB
10K SLoC

madsim-rdkafka

Crate Docs

The rdkafka simulator on madsim. Mirrors rdkafka v0.34.0 and librdkafka 2.3.0.

Usage

Replace all rdkafka entries in your Cargo.toml:

[dependencies]
rdkafka = { version = "0.4", package = "madsim-rdkafka" }

API Modification

This crate roughly follows the rdkafka API but is NOT exactly the same.

The following functions are modified to be async:

  • FromClientConfig::from_config
  • FromClientConfigAndContext::from_config_and_context
  • ClientConfig::create
  • ClientConfig::create_with_context
  • Client::fetch_metadata[^1]
  • Client::fetch_watermarks[^1]
  • Client::fetch_group_list[^1]
  • Consumer::seek
  • Consumer::seek_partitions
  • Consumer::commit
  • Consumer::commit_consumer_state
  • Consumer::commit_message
  • Consumer::committed
  • Consumer::committed_offsets
  • Consumer::offsets_for_timestamp
  • Consumer::offsets_for_times[^1]
  • Consumer::fetch_metadata[^1]
  • Consumer::fetch_watermarks[^1]
  • Consumer::fetch_group_list[^1]
  • Producer::flush
  • Producer::init_transactions
  • Producer::send_offsets_to_transaction
  • Producer::commit_transaction
  • Producer::abort_transaction

[^1]: wrapped in tokio::task::spawn_blocking

The associated constant ClientContext::ENABLE_REFRESH_OAUTH_TOKEN is changed to a function in order to make the trait object-safe.

DNS Resolution

This crate has cherry-picked a commit from Materialize to support rewriting broker addresses.

A new method is added to ClientContext:

  • ClientContext::rewrite_broker_addr

Dependencies

~13–28MB
~385K SLoC