Lib.rs

› Science › Machine learning
#model #api-bindings #llama #cpp #lib #qwen2

localllm

qwen2 model lib by llama.cpp

by ppc

2 unstable releases

0.2.0 Aug 18, 2024
0.1.0 Aug 17, 2024

#530 in Machine learning

Download history 22/week @ 2024-09-14 34/week @ 2024-09-21 7/week @ 2024-09-28 1/week @ 2024-10-12 30/week @ 2024-11-30 89/week @ 2024-12-07 23/week @ 2024-12-14 6/week @ 2024-12-21

148 downloads per month

MIT/Apache

7MB
136K SLoC

C++ 83K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 7.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments GLSL 3.5K SLoC // 0.0% comments Objective-C 2.5K SLoC // 0.0% comments Rust 319 SLoC // 0.1% comments Python 41 SLoC // 0.3% comments

localllm

qwen2 model lib by llama.cpp

set LLAMA_LIB="llama.lib ggml.lib common.lib dir"

llama.lib ggml.lib common.lib from https://github.com/hjiayz/build-llama.cpp

example model https://hf-mirror.com/Qwen/Qwen2-1.5B-Instruct-GGUF/blob/main/qwen2-1_5b-instruct-q2_k.gguf

Dependencies

~3.5–6.5MB
~111K SLoC