32 releases (stable)
new 2.0.0-rc.2 | Apr 27, 2024 |
---|---|
2.0.0-rc.1 | Mar 28, 2024 |
2.0.0-rc.0 | Feb 6, 2024 |
2.0.0-alpha.4 | Dec 28, 2023 |
1.13.1 | Nov 27, 2022 |
#5 in Machine learning
23,113 downloads per month
Used in 36 crates
(25 directly)
505KB
10K
SLoC
ort
is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference on both CPU & GPU.
π Documentation
π€ Support
π Projects using ort
Open a PR to add your project here π
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - pyke Diffusers uses
ort
for efficient Stable Diffusion image generation on both CPUs & GPUs. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres.
π Sponsor ort
Dependencies
~2β15MB
~183K SLoC