Lib.rs

› Text editors
#llm #daemon #language-server #run #script #running #python

llm-daemon

LLM as a daemon

by Jeong, Heon

27 releases

0.3.14 Sep 6, 2024
0.3.13 Jul 12, 2024
0.3.7 Jun 19, 2024
0.3.5 May 9, 2024
0.0.2 Apr 26, 2024

#101 in Text editors

Download history 26/week @ 2024-06-21 232/week @ 2024-06-28 32/week @ 2024-07-05 189/week @ 2024-07-12 31/week @ 2024-07-19 130/week @ 2024-07-26 144/week @ 2024-09-06 39/week @ 2024-09-13 44/week @ 2024-09-20 7/week @ 2024-09-27 4/week @ 2024-10-04

94 downloads per month

GPL-3.0-only

8MB
164K SLoC

C++ 85K SLoC // 0.1% comments C 35K SLoC // 0.1% comments Python 16K SLoC // 0.1% comments CUDA 7.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments GLSL 3.5K SLoC // 0.0% comments Objective-C 3K SLoC // 0.0% comments Shell 2.5K SLoC // 0.2% comments JavaScript 2.5K SLoC // 0.2% comments Rust 1.5K SLoC // 0.0% comments Swift 1K SLoC // 0.0% comments Kotlin 693 SLoC // 0.1% comments Gherkin (Cucumber) 559 SLoC // 0.1% comments Vim Script 134 SLoC // 0.1% comments RPM Specfile 108 SLoC // 0.2% comments Batch 77 SLoC // 0.2% comments Prolog 35 SLoC INI 6 SLoC

llm-daemon

Daemon to run llm server. Can be useful when you need a LLM server but don't want to run it on your own.

  • Language Server which requires LLM
  • Python script which requires LLM while it's running

Dependencies

~12–25MB
~400K SLoC