2 stable releases

1.0.1 Jan 23, 2024
1.0.0 Aug 9, 2023

#1175 in Text processing

42 downloads per month
Used in llmvm-core

MPL-2.0 license

83KB
1.5K SLoC

llmvm-core-lib

Crates.io docs.rs GitHub

The library for the llmvm core.

Assumes the following responsibilities:

  • Sending generation requests to backends
  • Managing message threads
  • Model presets
  • Prompt templates
  • Projects / workspaces

See the executable wrapper llmvm-core for more information.

Frontends may optionally use this crate directly to avoid using any IPC communciation.

Usage

Add the dependency to Cargo.toml:

[dependencies]
llmvm-core-lib = { version = "<version>" }

Reference documentation

Reference documentation can be found on docs.rs.

License

Mozilla Public License, version 2.0

Dependencies

~19–30MB
~555K SLoC