#machine-learning #ai

ort

A safe Rust wrapper for ONNX Runtime 1.17 - Optimize and Accelerate Machine Learning Inferencing

30 releases (stable)

2.0.0-rc.0 Feb 6, 2024
2.0.0-alpha.4 Dec 28, 2023
2.0.0-alpha.2 Nov 28, 2023
1.16.3 Nov 12, 2023
1.13.1 Nov 27, 2022

#3 in Machine learning

Download history 1326/week @ 2023-11-05 1729/week @ 2023-11-12 1792/week @ 2023-11-19 1956/week @ 2023-11-26 2305/week @ 2023-12-03 3033/week @ 2023-12-10 2668/week @ 2023-12-17 1598/week @ 2023-12-24 2290/week @ 2023-12-31 2667/week @ 2024-01-07 3110/week @ 2024-01-14 2404/week @ 2024-01-21 2350/week @ 2024-01-28 2750/week @ 2024-02-04 3185/week @ 2024-02-11 3726/week @ 2024-02-18

12,139 downloads per month
Used in 25 crates (18 directly)

MIT/Apache

410KB
8K SLoC


Coverage Results Crates.io Open Collective backers and sponsors
Crates.io ONNX Runtime

ort is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU.

πŸ“– Documentation

πŸ€” Support

πŸ’– Projects using ort

Open a PR to add your project here 🌟

  • Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
  • Bloop uses ort to power their semantic code search feature.
  • pyke Diffusers uses ort for efficient Stable Diffusion image generation on both CPUs & GPUs.
  • edge-transformers uses ort for accelerated transformer model inference at the edge.
  • Ortex uses ort for safe ONNX Runtime bindings in Elixir.

🌠 Sponsor ort


Dependencies

~3–14MB
~164K SLoC