#market-data #data-exchange #backtesting #trading #crypto #investment #stock

barter-data

High performance & normalised WebSocket intergration for leading cryptocurrency exchanges - batteries included

46 releases

0.7.0 Apr 16, 2023
0.6.9 Feb 18, 2023
0.6.7 Jan 22, 2023
0.5.11 Dec 18, 2022
0.2.10 Nov 27, 2021

#985 in Magic Beans

Download history 106/week @ 2023-12-11 120/week @ 2023-12-18 96/week @ 2023-12-25 93/week @ 2024-01-01 179/week @ 2024-01-08 121/week @ 2024-01-15 71/week @ 2024-01-22 26/week @ 2024-01-29 10/week @ 2024-02-05 65/week @ 2024-02-12 62/week @ 2024-02-19 35/week @ 2024-02-26 22/week @ 2024-03-04 40/week @ 2024-03-11 56/week @ 2024-03-18 52/week @ 2024-03-25

178 downloads per month
Used in 2 crates

MIT license

400KB
8K SLoC

Barter-Data

A high-performance WebSocket integration library for streaming public market data from leading cryptocurrency exchanges - batteries included. It is:

  • Easy: Barter-Data's simple StreamBuilder interface allows for easy & quick setup (see example below!).
  • Normalised: Barter-Data's unified interface for consuming public WebSocket data means every Exchange returns a normalised data model.
  • Real-Time: Barter-Data utilises real-time WebSocket integrations enabling the consumption of normalised tick-by-tick data.
  • Extensible: Barter-Data is highly extensible, and therefore easy to contribute to with coding new integrations!

See: Barter, Barter-Integration, Barter-Execution & Barter-Macro

Crates.io MIT licensed Build Status Discord chat

API Documentation | Chat

Overview

Barter-Data is a high-performance WebSocket integration library for streaming public market data from leading cryptocurrency exchanges. It presents an easy-to-use and extensible set of interfaces that can deliver normalised exchange data in real-time.

From a user perspective, the major component is the StreamBuilder structures that assists in initialising an arbitrary number of exchange MarketStreams using input Subscriptions. Simply build your dream set of MarketStreams and Barter-Data will do the rest!

Supported Exchange Subscriptions

Exchange Constructor Code InstrumentKinds SubKinds
BinanceSpot BinanceSpot::default() Spot PublicTrades
OrderBooksL1
OrderBooksL2
BinanceFuturesUsd BinanceFuturesUsd::default() Perpetual PublicTrades
OrderBooksL1
OrderBooksL2
Bitfinex Bitfinex Spot PublicTrades
Bitmex Bitmex Perpetual PublicTrades
BybitSpot BybitSpot::default() Spot PublicTrades
BybitPerpetualsUsd BybitPerpetualsUsd::default() Perpetual PublicTrades
Coinbase Coinbase Spot PublicTrades
GateioSpot GateioSpot::default() Spot PublicTrades
GateioFuturesUsd GateioFuturesUsd::default() Future PublicTrades
GateioFuturesBtc GateioFuturesBtc::default() Future PublicTrades
GateioPerpetualsUsd GateioPerpetualsUsd::default() Perpetual PublicTrades
GateioPerpetualsBtc GateioPerpetualsBtc::default() Perpetual PublicTrades
GateioOptionsBtc GateioOptions::default() Option PublicTrades
Kraken Kraken Spot PublicTrades
OrderBooksL1
Okx Okx Spot
Future
Perpetual
Option
PublicTrades

Examples

See barter-data-rs/examples for a more comprehensive selection of examples!

Multi Exchange Public Trades

use barter_data::{
    exchange::{
        binance::{futures::BinanceFuturesUsd, spot::BinanceSpot},
        bitmex::Bitmex,
        bybit::{futures::BybitPerpetualsUsd, spot::BybitSpot},
        coinbase::Coinbase,
        gateio::{
            option::GateioOptions,
            perpetual::{GateioPerpetualsBtc, GateioPerpetualsUsd},
            spot::GateioSpot,
        },
        okx::Okx,
    },
    streams::Streams,
    subscription::trade::PublicTrades,
};
use barter_integration::model::instrument::kind::{
    FutureContract, InstrumentKind, OptionContract, OptionExercise, OptionKind,
};
use chrono::{TimeZone, Utc};
use futures::StreamExt;
use tracing::info;

#[tokio::main]
async fn main() {
    // Initialise PublicTrades Streams for various exchanges
    // '--> each call to StreamBuilder::subscribe() creates a separate WebSocket connection
    let streams = Streams::<PublicTrades>::builder()
        .subscribe([
            (BinanceSpot::default(), "btc", "usdt", InstrumentKind::Spot, PublicTrades),
            (BinanceSpot::default(), "eth", "usdt", InstrumentKind::Spot, PublicTrades),
        ])
        .subscribe([
            (BinanceFuturesUsd::default(), "btc", "usdt", InstrumentKind::Perpetual, PublicTrades),
            (BinanceFuturesUsd::default(), "eth", "usdt", InstrumentKind::Perpetual, PublicTrades),
        ])
        .subscribe([
            (Coinbase, "btc", "usd", InstrumentKind::Spot, PublicTrades),
            (Coinbase, "eth", "usd", InstrumentKind::Spot, PublicTrades),
        ])
        .subscribe([
            (GateioSpot::default(), "btc", "usdt", InstrumentKind::Spot, PublicTrades),
        ])
        .subscribe([
            (GateioPerpetualsUsd::default(), "btc", "usdt", InstrumentKind::Perpetual, PublicTrades),
        ])
        .subscribe([
            (GateioPerpetualsBtc::default(), "btc", "usd", InstrumentKind::Perpetual, PublicTrades),
        ])
        .subscribe([
            (GateioOptions::default(), "btc", "usdt", InstrumentKind::Option(put_contract()), PublicTrades),
        ])
        .subscribe([
            (Okx, "btc", "usdt", InstrumentKind::Spot, PublicTrades),
            (Okx, "btc", "usdt", InstrumentKind::Perpetual, PublicTrades),
            (Okx, "btc", "usd", InstrumentKind::Future(future_contract()), PublicTrades),
            (Okx, "btc", "usd", InstrumentKind::Option(call_contract()), PublicTrades),
        ])
        .subscribe([
            (BybitSpot::default(), "btc", "usdt", InstrumentKind::Spot, PublicTrades),
            (BybitSpot::default(), "eth", "usdt", InstrumentKind::Spot, PublicTrades),
        ])
        .subscribe([
            (BybitPerpetualsUsd::default(), "btc", "usdt", InstrumentKind::Perpetual, PublicTrades),
        ])
        .subscribe([
            (Bitmex, "xbt", "usd", InstrumentKind::Perpetual, PublicTrades)
        ])
        .init()
        .await
        .unwrap();

    // Join all exchange PublicTrades streams into a single tokio_stream::StreamMap
    // Notes:
    //  - Use `streams.select(ExchangeId)` to interact with the individual exchange streams!
    //  - Use `streams.join()` to join all exchange streams into a single mpsc::UnboundedReceiver!
    let mut joined_stream = streams.join_map().await;

    while let Some((exchange, trade)) = joined_stream.next().await {
        info!("Exchange: {exchange}, MarketEvent<PublicTrade>: {trade:?}");
    }
}

Getting Help

Firstly, see if the answer to your question can be found in the API Documentation. If the answer is not there, I'd be happy to help via Chat and try answer your question via Discord.

Contributing

Thanks in advance for helping to develop the Barter ecosystem! Please do get hesitate to get touch via the Discord Chat to discuss development, new features, and the future roadmap.

Adding A New Exchange Connector

  1. Add a new Connector trait implementation in src/exchange/<exchange_name>.mod.rs (eg/ see exchange::okx::Okx).
  2. Follow on from "Adding A New Subscription Kind For An Existing Exchange Connector" below!

Adding A New Subscription Kind For An Existing Exchange Connector

  1. Add a new SubKind trait implementation in src/subscription/<sub_kind_name>.rs (eg/ see subscription::trade::PublicTrades).
  2. Define the SubKind::Event data model (eg/ see subscription::trade::PublicTrade).
  3. Define the MarketStream type the exchange Connector will initialise for the new SubKind:
    ie/ impl StreamSelector<SubKind> for <ExistingExchangeConnector> { ... }
  4. Try to compile and follow the remaining steps!
  5. Add a barter-data-rs/examples/<sub_kind_name>_streams.rs example in the standard format :)

In addition to the Barter-Execution crate, the Barter project also maintains:

  • Barter: High-performance, extensible & modular trading components with batteries-included. Contains a pre-built trading Engine that can serve as a live-trading or backtesting system.
  • Barter-Integration: High-performance, low-level framework for composing flexible web integrations.
  • Barter-Execution: High-performance WebSocket integration library for streaming public market data from leading cryptocurrency exchanges.
  • Barter-Macro: Barter ecosystem macros.

Roadmap

  • Add support for more exchanges (easy to help with!)
  • Add support for more subscription kinds (easy to help with!)

Licence

This project is licensed under the MIT license.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in Barter-Data by you, shall be licensed as MIT, without any additional terms or conditions.

Dependencies

~16–31MB
~566K SLoC