#ai #llm #api-bindings

llmvm-core-lib

The library for the llmvm core application

5 stable releases

1.1.3 Sep 19, 2024
1.1.2 Jun 24, 2024
1.1.1 Jun 23, 2024
1.0.1 Jan 23, 2024
1.0.0 Aug 9, 2023

#1460 in Text processing

Download history 1/week @ 2024-06-16 269/week @ 2024-06-23 4/week @ 2024-07-21 22/week @ 2024-07-28 120/week @ 2024-09-15 23/week @ 2024-09-22 11/week @ 2024-09-29

154 downloads per month
Used in llmvm-core

MPL-2.0 license

83KB
1.5K SLoC

llmvm-core-lib

Crates.io docs.rs GitHub

The library for the llmvm core.

Assumes the following responsibilities:

  • Sending generation requests to backends
  • Managing message threads
  • Model presets
  • Prompt templates
  • Projects / workspaces

See the executable wrapper llmvm-core for more information.

Frontends may optionally use this crate directly to avoid using any IPC communciation.

Usage

Add the dependency to Cargo.toml:

[dependencies]
llmvm-core-lib = { version = "<version>" }

Reference documentation

Reference documentation can be found on docs.rs.

License

Mozilla Public License, version 2.0

Dependencies

~18–29MB
~532K SLoC