11 breaking releases

0.12.1 Aug 26, 2023
0.12.0 Jan 29, 2023
0.11.0 Mar 28, 2022
0.10.0 Jun 21, 2021
0.3.0 Mar 21, 2018

#268 in Database interfaces

Download history 73/week @ 2024-07-19 133/week @ 2024-07-26 73/week @ 2024-08-02 119/week @ 2024-08-09 45/week @ 2024-08-16 151/week @ 2024-08-23 96/week @ 2024-08-30 146/week @ 2024-09-06 94/week @ 2024-09-13 119/week @ 2024-09-20 107/week @ 2024-09-27 145/week @ 2024-10-04 151/week @ 2024-10-11 113/week @ 2024-10-18 81/week @ 2024-10-25 102/week @ 2024-11-01

489 downloads per month

MIT/Apache

3MB
72K SLoC

C++ 38K SLoC // 0.1% comments Python 15K SLoC // 0.1% comments Rust 10K SLoC // 0.0% comments CUDA 9K SLoC // 0.1% comments BASH 622 SLoC // 0.1% comments C 176 SLoC // 0.1% comments Shell 109 SLoC // 0.3% comments Batch 27 SLoC // 0.3% comments

Faiss-rs

faiss at crates.io Continuous integration status Minimum Rust Version Stable dependency status

This project provides Rust bindings to Faiss, the state-of-the-art vector search and clustering library.

Installing with dynamic linking

By default, this crate is dynamically linked with the Faiss library installed in your system, so it does not build Faiss automatically for you. To build the library yourself:

  1. Follow the instructions here to build Faiss using CMake, enabling the variables FAISS_ENABLE_C_API and BUILD_SHARED_LIBS. The crate is currently only compatible with version v1.7.2. Consider building Faiss from this fork, c_api_head branch, which will contain the latest supported bindings to the C interface. For example:

    cmake -B build -DFAISS_ENABLE_C_API=ON -DBUILD_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=Release
    cmake --build build
    

    This will result in the dynamic library faiss_c ("c_api/libfaiss_c.so" on Linux), which needs to be installed in a place where your system will pick up (in Linux, try somewhere in the LD_LIBRARY_PATH environment variable, such as "/usr/lib", or try adding a new path to this variable). For GPU support, don't forget to enable the option FAISS_ENABLE_GPU. Note: faiss_c might link dynamically to the native faiss library, which in that case you will need to install the main shared object (faiss/libfaiss.so) as well.

  2. You are now ready to include this crate as a dependency:

    [dependencies]
    "faiss" = "0.11.0"
    

If you have built Faiss with GPU support, you can include the "gpu" Cargo feature:

[dependencies]
"faiss" = { version = "0.11.0", features = ["gpu"] }

Installing with static linking

Alternatively to the above, enable the "static" Cargo feature to let Rust build Faiss for you. You will still need the dependencies required to build and run Faiss as described in their INSTALL.md, namely a compatible C++ compiler and a BLAS implementation.

[dependencies]
"faiss" = { version = "0.11.0", features = ["static"] }

Compiling Faiss with GPU support is also possible.

[dependencies]
"faiss" = { version = "0.11.0", features = ["static", "gpu"] }

Using

A basic example is seen below. Please check out the documentation for more.

use faiss::{Index, index_factory, MetricType};

let mut index = index_factory(64, "Flat", MetricType::L2)?;
index.add(&my_data)?;

let result = index.search(&my_query, 5)?;
for (i, (l, d)) in result.labels.iter()
    .zip(result.distances.iter())
    .enumerate()
{
    println!("#{}: {} (D={})", i + 1, *l, *d);
}

License and attribution notice

Licensed under either of

at your option.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

This work is not affiliated with Facebook AI Research or the main Faiss software.

Dependencies