Cargo Features
tiktoken-rs has no features set by default.
[dependencies]
tiktoken-rs = { version = "0.5.8", features = ["python", "async-openai", "dhat-heap"] }- python
-
build python bindings
Enables pyo3 ^0.19.2
Affects
vendor_tiktoken::CoreBPE… - async-openai
-
Enables async-openai ^0.14.2
Affects
api::async_openai… - dhat-heap
-
Enables dhat