#onnx-run-time #machine-learning #artificial-intelligence #sys

sys ort-sys

Unsafe Rust bindings for ONNX Runtime 1.20 - Optimize and Accelerate Machine Learning Inferencing

14 releases

2.0.0-rc.9 Nov 21, 2024
2.0.0-rc.6 Sep 10, 2024
2.0.0-rc.4 Jul 7, 2024
2.0.0-rc.1 Mar 28, 2024
2.0.0-alpha.2 Nov 28, 2023

#805 in Machine learning

Download history 19782/week @ 2024-12-05 19260/week @ 2024-12-12 15776/week @ 2024-12-19 11224/week @ 2024-12-26 14728/week @ 2025-01-02 24391/week @ 2025-01-09 23028/week @ 2025-01-16 21397/week @ 2025-01-23 19606/week @ 2025-01-30 54382/week @ 2025-02-06 104603/week @ 2025-02-13 125135/week @ 2025-02-20 141710/week @ 2025-02-27 127150/week @ 2025-03-06 119765/week @ 2025-03-13 84931/week @ 2025-03-20

495,233 downloads per month
Used in 62 crates (via kalosm-sound)

MIT/Apache

205KB
4K SLoC


Coverage Results Crates.io Open Collective backers and sponsors
Crates.io ONNX Runtime

ort is an (unofficial) ONNX Runtime 1.21 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference and training on both CPU & GPU.

📖 Documentation

🤔 Support

💖 Projects using ort

Open a PR to add your project here 🌟

  • Bloop uses ort to power their semantic code search feature.
  • edge-transformers uses ort for accelerated transformer model inference at the edge.
  • Ortex uses ort for safe ONNX Runtime bindings in Elixir.
  • Supabase uses ort to remove cold starts for their edge functions.
  • Lantern uses ort to provide embedding model inference inside Postgres.
  • Magika uses ort for content type detection.
  • sbv2-api is a fast implementation of Style-BERT-VITS2 text-to-speech using ort.
  • Ahnlich uses ort to power their AI proxy for semantic search applications.
  • Spacedrive is a cross-platform file manager with AI features powered by ort.
  • BoquilaHUB uses ort for local AI deployment in biodiversity conservation efforts.

🌠 Sponsor ort


No runtime deps

~0–1.1MB
~14K SLoC