4 releases (2 breaking)
new 0.4.0 | Dec 2, 2024 |
---|---|
0.3.0 | Nov 28, 2024 |
0.2.1 | Nov 23, 2024 |
0.2.0 | Nov 14, 2024 |
#52 in Machine learning
418 downloads per month
185KB
3.5K
SLoC
Ollama Kernel
Experimental Jupyter Kernel for Ollama, allowing you to talk to local models like Llama 3, Qwen, Mistral, and more via Jupyter Notebooks and other clients.
Installation
cargo install ollama-kernel
ollama-kernel --install
Usage
Once installed, Jupyter should automatically detect the kernel.
This was made out of love for Ollama, a local model server for LLMs.
Dependencies
~19–32MB
~568K SLoC