45 releases (breaking)

Uses new Rust 2024

0.34.0 Apr 10, 2025
0.32.1 Mar 29, 2025
0.24.0 Nov 29, 2024
0.22.1 Jul 29, 2024
0.13.0 Mar 27, 2024

#165 in Machine learning

Download history 11/week @ 2025-02-12 35/week @ 2025-02-26 114/week @ 2025-03-19 924/week @ 2025-03-26 139/week @ 2025-04-02 175/week @ 2025-04-09 21/week @ 2025-04-16

401 downloads per month

MIT license

220KB
4K SLoC

about this workspace

ease your way to work with openai, gemini and anthropic api

[!WARNING] wip, not stable.

await-openai

compare to async-openai

  • dedicate completion chunk type
  • only types

features

tool

blazing fast serilization compared to openai-func-enums

claude

transform openai's request to anthropic's request.

transform anthropic's response to openai's response.

rmcp

bidirectional convert between openai's tool and rmcp's tool.

benchmark

Test Category Test Performed Time (ns or µs) Outliers
Deserialize Default Request 413.61 ns - 415.89 ns
Deserialize Default Request with async-openai 432.63 ns - 433.11 ns 6 (6.00%): 2 low mild, 2 high mild, 2 high severe
Deserialize Image Input Request 1.1024 µs - 1.1066 µs 5 (5.00%): 1 low severe, 1 low mild, 2 high mild, 1 high severe
Serialize Default Request 477.29 ns - 479.68 ns
Serialize With async-openai builder pattern 847.53 ns - 851.97 ns 6 (6.00%): 1 low mild, 3 high mild, 2 high severe
Serialize Function Tool 910.31 ns - 912.73 ns 13 (13.00%): 5 high mild, 8 high severe
Serialize Function Tool with Func Enum 6.4547 µs - 6.4676 µs 8 (8.00%): 6 high mild, 2 high severe

async-gemini

async-claude

Dependencies

~0.6–7.5MB
~56K SLoC