2 unstable releases
0.2.0 | Aug 18, 2024 |
---|---|
0.1.0 | Aug 17, 2024 |
#505 in Machine learning
7MB
136K
SLoC
localllm
qwen2 model lib by llama.cpp
set LLAMA_LIB="llama.lib ggml.lib common.lib dir"
llama.lib ggml.lib common.lib from https://github.com/hjiayz/build-llama.cpp
example model https://hf-mirror.com/Qwen/Qwen2-1.5B-Instruct-GGUF/blob/main/qwen2-1_5b-instruct-q2_k.gguf
Dependencies
~3.5–6.5MB
~111K SLoC