20 releases (8 breaking)

new 0.12.1 Jul 11, 2024
0.11.4 Jul 1, 2024
0.5.0 Mar 25, 2024

#180 in Machine learning

Download history 15/week @ 2024-03-15 138/week @ 2024-03-22 121/week @ 2024-03-29 314/week @ 2024-04-05 172/week @ 2024-04-12 305/week @ 2024-04-19 326/week @ 2024-04-26 136/week @ 2024-05-03 197/week @ 2024-05-10 241/week @ 2024-05-17 341/week @ 2024-05-24 171/week @ 2024-05-31 55/week @ 2024-06-07 23/week @ 2024-06-14 169/week @ 2024-06-21 149/week @ 2024-06-28

553 downloads per month

Apache-2.0

500KB
10K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.


lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~33–51MB
~499K SLoC