2 releases
0.1.2 | Nov 16, 2024 |
---|---|
0.1.1 | Nov 15, 2024 |
#614 in Development tools
92 downloads per month
17KB
222 lines
Copilot
Overview
Copilot Rust SDK is a Rust library for interacting with the chat model. It provides integration with the chat API, support for custom function tools, and message handling.
Features
- Chat model integration: Interact with the chat API through the
ChatModel
structure. - Custom function tool: Implement custom function tools using
FunctionTool
andFunctiomImplTrait
. - Macro support: Simplify function tool injection and configuration using
complete
macro.
Installation
Add the following dependencies to your Cargo.toml
:
copilot-rs = "0.1.2"
Usage
Chat model integration
To interact with the chat model, you need to create a ChatModel
instance with the necessary configuration.
normally, you can use the ChatModel::builder()
method to create a ChatModel
instance.
or you can use serde to deserialize a ChatModel
instance from a JSON string.
then use complete macro to inject paramaters and function tools into the chat function.
fn client() -> copilot_rs::ChatModel {
...
}
#[complete(client="client", temperature=0.6, max_tokens=1000, tools=["GetCurrentWeather","Add"])]
fn test(name: &str) -> String {
vec![format!("{}今天天气怎么样",name).user()].chat()
}
Custom function tool
You can define your own function tool by implementing the FunctionTool
and FunctiomImplTrait
traits.
also, you need implement serde's Deserialize
and Serialize
traits. beacuse copilot-rs will use serde to deserialize the function tool from a JSON string.
#[derive(FunctionTool, Deserialize, Serialize)]
#[property(desc = "Get weather of an location, the user shoud supply a location first")]
struct GetCurrentWeather {
#[property(desc = "The city and state, e.g. San Francisco, CA")]
location: String,
}
impl FunctionImplTrait for GetCurrentWeather {
fn exec(&self) -> String {
"大暴雨,由于雨势太大,可能发生洪灾".to_string()
}
}
more detail, please see the example in the src/main.rs
file.
TODO
- Structure output
- More examples
- Agent
- SSE support
Notice
This project is still in the early stages of development. It is not yet ready for production use. if you have some issues with it, please feel free to open an issue or submit a pull request.
Dependencies
~4–15MB
~198K SLoC