Lib.rs

› Science › Machine learning
#chat-bot #model #llm #rag #api-server #llama #applications

llama-core

The core library of LlamaEdge

by Xin Liu and 11 contributors

37 releases (16 breaking)

0.20.0 Oct 11, 2024
0.19.1 Sep 29, 2024
0.13.1 Jul 25, 2024
0.5.0 Mar 25, 2024

#162 in Machine learning

Download history 336/week @ 2024-07-01 133/week @ 2024-07-08 147/week @ 2024-07-15 244/week @ 2024-07-22 114/week @ 2024-07-29 169/week @ 2024-08-05 13/week @ 2024-08-12 175/week @ 2024-08-19 179/week @ 2024-08-26 164/week @ 2024-09-02 310/week @ 2024-09-09 265/week @ 2024-09-16 826/week @ 2024-09-23 320/week @ 2024-09-30 333/week @ 2024-10-07 93/week @ 2024-10-14

1,588 downloads per month

Apache-2.0

800KB
16K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~27–42MB
~536K SLoC