14 releases
2.0.0-rc.9 | Nov 21, 2024 |
---|---|
2.0.0-rc.6 | Sep 10, 2024 |
2.0.0-rc.4 | Jul 7, 2024 |
2.0.0-rc.1 | Mar 28, 2024 |
2.0.0-alpha.2 | Nov 28, 2023 |
#805 in Machine learning
495,233 downloads per month
Used in 62 crates
(via kalosm-sound)
205KB
4K
SLoC
ort
is an (unofficial) ONNX Runtime 1.21 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
📖 Documentation
🤔 Support
💖 Projects using ort
Open a PR to add your project here 🌟
- Bloop uses
ort
to power their semantic code search feature. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres. - Magika uses
ort
for content type detection. sbv2-api
is a fast implementation of Style-BERT-VITS2 text-to-speech usingort
.- Ahnlich uses
ort
to power their AI proxy for semantic search applications. - Spacedrive is a cross-platform file manager with AI features powered by
ort
. - BoquilaHUB uses
ort
for local AI deployment in biodiversity conservation efforts.
🌠 Sponsor ort
No runtime deps
~0–1.1MB
~14K SLoC