#ai #llm #api-bindings

llmvm-core-lib

The library for the llmvm core application

6 stable releases

1.1.4 Oct 22, 2024
1.1.3 Sep 19, 2024
1.1.2 Jun 24, 2024
1.0.1 Jan 23, 2024
1.0.0 Aug 9, 2023

#1531 in Text processing

34 downloads per month
Used in llmvm-core

MPL-2.0 license

83KB
1.5K SLoC

llmvm-core-lib

Crates.io docs.rs GitHub

The library for the llmvm core.

Assumes the following responsibilities:

  • Sending generation requests to backends
  • Managing message threads
  • Model presets
  • Prompt templates
  • Projects / workspaces

See the executable wrapper llmvm-core for more information.

Frontends may optionally use this crate directly to avoid using any IPC communciation.

Usage

Add the dependency to Cargo.toml:

[dependencies]
llmvm-core-lib = { version = "<version>" }

Reference documentation

Reference documentation can be found on docs.rs.

License

Mozilla Public License, version 2.0

Dependencies

~19–33MB
~539K SLoC