Lib.rs

---

ort is an (unofficial) ONNX Runtime 1.20 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference and training on both CPU & GPU.

📖 Documentation

• Guide
• API reference
• Examples
• Migrating from v1.x to v2.0

🤔 Support

• Discord: #💬｜ort-discussions
• GitHub Discussions
• Email

💖 Projects using ort

_{Open a PR to add your project here 🌟}

• Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
• Bloop uses ort to power their semantic code search feature.
• edge-transformers uses ort for accelerated transformer model inference at the edge.
• Ortex uses ort for safe ONNX Runtime bindings in Elixir.
• Supabase uses ort to remove cold starts for their edge functions.
• Lantern uses ort to provide embedding model inference inside Postgres.
• Magika uses ort for content type detection.
• sbv2-api is a fast implementation of Style-BERT-VITS2 text-to-speech using ort.

🌠 Sponsor ort