Lib.rs

›
#openai #capability #token #projects #integration #performance #calculate

tiktoken

by lihaooo

1 stable release

1.0.1 Aug 18, 2023

#26 in #capability

Download history 20/week @ 2024-07-22 46/week @ 2024-07-29 3/week @ 2024-08-05 7/week @ 2024-08-12 3/week @ 2024-08-19 7/week @ 2024-08-26 8/week @ 2024-09-02 21/week @ 2024-09-09 12/week @ 2024-09-16 48/week @ 2024-09-23 20/week @ 2024-09-30 29/week @ 2024-10-07 70/week @ 2024-10-21

121 downloads per month

MIT license

1.5MB
502 lines

An efficient Rust implementation of tiktoken, enhanced with the capability to calculate OpenAI token costs. Crafted for performance, accuracy, and seamless integration into your projects.

Dependencies

~5.5MB
~113K SLoC