31 releases (stable)
2.0.0-rc.1 | Mar 28, 2024 |
---|---|
2.0.0-alpha.4 | Dec 28, 2023 |
2.0.0-alpha.2 | Nov 28, 2023 |
1.16.3 | Nov 12, 2023 |
1.13.1 | Nov 27, 2022 |
#3 in Machine learning
22,022 downloads per month
Used in 35 crates
(25 directly)
490KB
10K
SLoC
ort
is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference on both CPU & GPU.
π Documentation
π€ Support
π Projects using ort
Open a PR to add your project here π
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - pyke Diffusers uses
ort
for efficient Stable Diffusion image generation on both CPUs & GPUs. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir.
π Sponsor ort
Dependencies
~2β13MB
~147K SLoC