4 releases (2 breaking)

new 0.4.0 Dec 2, 2024
0.3.0 Nov 28, 2024
0.2.1 Nov 23, 2024
0.2.0 Nov 14, 2024

#52 in Machine learning

Download history 105/week @ 2024-11-11 151/week @ 2024-11-18 162/week @ 2024-11-25

418 downloads per month

BSD-3-Clause

185KB
3.5K SLoC

Ollama Kernel

Experimental Jupyter Kernel for Ollama, allowing you to talk to local models like Llama 3, Qwen, Mistral, and more via Jupyter Notebooks and other clients.

Installation

cargo install ollama-kernel
ollama-kernel --install

Usage

Once installed, Jupyter should automatically detect the kernel.

This was made out of love for Ollama, a local model server for LLMs.

Dependencies

~19–32MB
~568K SLoC