3 unstable releases
new 0.2.0 | Nov 20, 2024 |
---|---|
0.1.1 | Nov 19, 2024 |
0.1.0 | Nov 18, 2024 |
#153 in Template engine
72 downloads per month
42KB
937 lines
modelfile
A parser and serde compatible structure for Ollama Modelfiles written in Rust. 🦀
The Modelfile format isn't based on any existing format but is loosely modeled after Dockerfile.
The parser is based on the nom
crate
and tested on a few distinct Modelfiles.
If you find a Modelfile that doesn't parse,
please open an issue!
I have a Modelfile, but I want a struct
!
Good news!
use modelfile::modelfile::Modelfile;
fn parse() {
let my_modelfile_string = std::fs::read_to_string("./test/llama3.2:latest.Modelfile")
.expect("handle your dang errors");
let my_modelfile: Modelfile = my_modelfile_string.parse()
.expect("if your Modelfile is good this should work!");
let mut builder = my_modelfile.build_on();
let builder = builder
.system("You are a malevolent, world-ending AI agent")
.expect("only one system message allowed");
let my_new_modelfile = builder.build()
.expect("you did it right. you're smart")
.render();
std::fs::write("Modelfile", my_new_modelfile)
.expect("should be able to write to your own dang disk");
}
Dependencies
~1.4–2.2MB
~45K SLoC