#pool #sync #chain #blockchain #different #across #synchronizing

bin+lib pool-sync

A library for synchronizing and managing various types of liquidity pools across different blockchains

28 releases (15 stable)

3.0.0 Nov 11, 2024
2.0.1 Aug 19, 2024
1.0.11 Aug 6, 2024
1.0.3 Jul 31, 2024
0.1.0 Jun 30, 2024

#744 in Magic Beans

Download history 576/week @ 2024-07-29 836/week @ 2024-08-05 195/week @ 2024-08-12 154/week @ 2024-08-19 3/week @ 2024-08-26 45/week @ 2024-09-16 89/week @ 2024-09-23 5/week @ 2024-09-30 1/week @ 2024-10-07 141/week @ 2024-11-11

141 downloads per month
Used in gweiyser

MIT/Apache

1MB
24K SLoC

Solidity 21K SLoC // 0.1% comments Rust 3.5K SLoC // 0.0% comments Python 494 SLoC // 0.0% comments

PoolSync

PoolSync is a utility crate for efficiently synchronizing DeFi pools from various protocols on EVM-compatible blockchains. This crate streamlines the process of pool synchronization, eliminating the need for repetitive boilerplate code in DeFi projects.

Installation

Add this to your Cargo.toml:

[dependencies]
pool-sync = "3.0.0"

Configure your .env with a full node and a archive node. Archive must be an archive node. The full node can be either. It is designed this way due to the fact the fact that is it much more accessible to host full nodes due to the storage requirements. The typical workflow is to use a paid archive endpoint for the initial intensive sync and let the fullnode take it from there. After the initial sync, all information will be cached and the strain on the endpoints is reduced immensely.

FULL = "full node endpoint"
ARCHIVE = "archive node endpoint"

Supported Protocols

ETH

  • UniswapV2/V3
  • SushiswapV2/V2
  • PancakeswapV2/V3
  • MaverickV1/V2

Base

  • UniswapV2/V3
  • SushiswapV2/V3
  • PancakeswapV2/V3
  • BaseswapV2/V3
  • MaverickV1/V2
  • Aerodrome/Slipstream
  • AlienBase

Example Usage

use pool_sync::{PoolSync, PoolType, Chain, PoolInfo};

#[tokio::main]
async fn main() -> Result<()> {
    // Configure and build the PoolSync instance
    let pool_sync = PoolSync::builder()
        .add_pool(PoolType::UniswapV2)
        .chain(Chain::Ethereum)
        .build()?;

    // Synchronize pools
    let (pools, last_synced_block) = pool_sync.sync_pools().await?;

    // Common Info
    for pool in &pools {
        println!("Pool Address {:?}, Token 0: {:?}, Token 1: {:?}", pool.address(), pool.token0_name(), pool.token1_name());
    }

    println!("Synced {} pools!", pools.len());
    Ok(())
}

How to add a new protocol

If the protocol already exists

  1. Add the factory address to the proper fetcher in pools/pool_fetchers
  2. If the chain does not exist, modify the chain enum and mapping in chain.rs to reflect it.

If the protocol does not exist

  1. Add the pool abi to pools/abi
  2. Create a new directory in pools/pool_fetchers with the relevant pool files. Implement the PoolFetcher trait. This is very simple to implement and is used for event parsing. Use other implementations as an example.
  3. Most pools will fit into the structures defined in pools/pool_structures. In the case that it is not, create a new file for your pool type, define the structure of the pool, and implement From<&DynSolValue]> for the pool.
  4. Go through pools/mod.rs and add your new pool variant to all relevant sections. Very straighforward
  5. Include your fetcher in builder.rs
  6. Add the pool type to the proper chain in chain.rs

Todo

  • Much better instructions to add new pools (sorry, this repo is constantly evolving so I dont want to commit to anything yet)
  • Abstract logic into macro for easy pool addition in pools/mod.rs
  • Implement rate limiting to make it possible to sync on free public endpoints
  • Add option to use DB directly for sync.

Acknowledgment

Took a ton of inspiration from amm-rs. Make sure to check them out, super great work there! :)

Dependencies

~37–52MB
~1M SLoC