34 releases (stable)
2.0.0-rc.4 | Jul 7, 2024 |
---|---|
2.0.0-rc.2 | Apr 27, 2024 |
2.0.0-rc.1 | Mar 28, 2024 |
2.0.0-alpha.4 | Dec 28, 2023 |
1.13.1 | Nov 27, 2022 |
#1 in Machine learning
57,357 downloads per month
Used in 47 crates
(31 directly)
580KB
11K
SLoC
ort
is an (unofficial) ONNX Runtime 1.18 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
π Documentation
π€ Support
π Projects using ort
Open a PR to add your project here π
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres. - Magika uses
ort
for content type detection.
π Sponsor ort
Dependencies
~2β14MB
~181K SLoC