2 releases

new 0.2.1-rc.2 May 9, 2025

#478 in Algorithms

Download history 168/week @ 2025-05-04

168 downloads per month

Apache-2.0

110KB
2.5K SLoC

Rust 1.5K SLoC // 0.1% comments C++ 1K SLoC // 0.0% comments

Rust Bindings for NIXL

Rust bindings for the NVIDIA Inference Xfer Library (NIXL). These bindings provide a safe and idiomatic Rust interface to the NIXL C++ library.

Prerequisites

Install Rust and Cargo using rustup:

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

Install the NIXL library on your system

Refer to the NIXL README for instructions on how to install the NIXL library on your system.

Building

The bindings can be built using Cargo, Rust's package manager:

# From the src/bindings/rust directory
cargo build

Environment Variables

  • NIXL_PREFIX: Path to the NIXL installation (default: /opt/nvidia/nvda_nixl)

Documentation

The crate is documented using Rust's standard documentation system. You can generate and view the documentation with:

cargo doc

Testing

The bindings include a comprehensive test suite that can be run with:

cargo test

Dependencies

~0.6–3.5MB
~69K SLoC