Lib.rs

› Science › Machine learning
#chat-bot #model #llm #rag #api-server #llama #applications

llama-core

The core library of LlamaEdge

by Xin Liu and 13 contributors

54 releases (22 breaking)

new 0.26.1 Jan 13, 2025
0.25.3 Jan 6, 2025
0.25.2 Dec 18, 2024
0.23.3 Nov 29, 2024
0.5.0 Mar 25, 2024

#204 in Machine learning

Download history 663/week @ 2024-09-22 490/week @ 2024-09-29 320/week @ 2024-10-06 111/week @ 2024-10-13 7/week @ 2024-10-20 262/week @ 2024-10-27 231/week @ 2024-11-03 189/week @ 2024-11-10 184/week @ 2024-11-17 501/week @ 2024-11-24 56/week @ 2024-12-01 846/week @ 2024-12-08 224/week @ 2024-12-15 22/week @ 2024-12-22 14/week @ 2024-12-29 303/week @ 2025-01-05

624 downloads per month

Apache-2.0

1MB
19K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~26–41MB
~508K SLoC