9 releases

0.1.9 Jun 28, 2022
0.1.8 Jun 28, 2022
0.1.7 May 8, 2022
0.1.6 Apr 29, 2022
0.1.1 Mar 27, 2022

#335 in Database interfaces

Download history 17/week @ 2022-11-27 17/week @ 2022-12-04 42/week @ 2022-12-11 79/week @ 2022-12-18 56/week @ 2022-12-25 14/week @ 2023-01-01 64/week @ 2023-01-08 32/week @ 2023-01-15 27/week @ 2023-01-22 37/week @ 2023-01-29 78/week @ 2023-02-05 91/week @ 2023-02-12 31/week @ 2023-02-19 50/week @ 2023-02-26 61/week @ 2023-03-05 48/week @ 2023-03-12

200 downloads per month

Apache-2.0

160KB
4K SLoC

callysto

Requirements

  • cmake
  • clang
  • libtool
  • libstdc++-devel

Rust MSRV

We are using:

cargo 1.60.0 (d1fd9fe 2022-03-01)

Running

With Docker Compose - Nerdctl Compose

  1. You need to have docker installation locally. With containerd backend, if you want to bring single node Kafka replacement use:
nerdctl compose up

If you want to bring Confluent Kafka single node. You can:

nerdctl compose -f docker-compose.kafkasn.yml

If you want to bring full blown Confluent Kafka cluster. Use:

nerdctl compose -f docker-compose.kafkacluster.yml

Mind that nerdctl command is interchangeable with docker.

With K8S

  1. You need to have K8S installation locally.
cd k8s && kubectl apply -f . && kubectl port-forward svc/redpanda 9092:9092
  1. Now you can run the producers in Python.
virtualenv venv
source venv/bin/activate
which pip3 # check that it is pointing to venv
pip3 install aiokafka -U
python examples/producer.py
  1. Now you can spawn the double agent example (without durability).
RUST_LOG="info,rdkafka::client=warn" RUST_BACKTRACE=full cargo run --example double-agent

Environment variables passed above is optional, but suggested for development.

Dependencies

~19–32MB
~631K SLoC