54 releases (22 breaking)

new 0.26.1 Jan 13, 2025
0.25.3 Jan 6, 2025
0.25.2 Dec 18, 2024
0.23.3 Nov 29, 2024
0.5.0 Mar 25, 2024

#204 in Machine learning

Download history 663/week @ 2024-09-22 490/week @ 2024-09-29 320/week @ 2024-10-06 111/week @ 2024-10-13 7/week @ 2024-10-20 262/week @ 2024-10-27 231/week @ 2024-11-03 189/week @ 2024-11-10 184/week @ 2024-11-17 501/week @ 2024-11-24 56/week @ 2024-12-01 846/week @ 2024-12-08 224/week @ 2024-12-15 22/week @ 2024-12-22 14/week @ 2024-12-29 303/week @ 2025-01-05

624 downloads per month

Apache-2.0

1MB
19K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.


lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~26–41MB
~508K SLoC