toi_client

A proof-of-concept for a minimal, terminal-based chat client for interacting with the personal assistant server.

Features

• Basic context size management based on token usage
• CTRL+C to interrupt the response stream during a response
• CTRL+C to clear the input buffer when it isn't empty
• CTRL+C to exit when the input buffer is empty

Notable dependencies

• ctrlc for some CTRL+C signal handling
• pico-args for the CLI argument parser
• reqwest for the HTTP client
• rustyline for the REPL interface
• serde and serde_json for the serialization/deserialization stuff
• tokio for async stuff

Related artifacts

• A library dependency
• A server to interact with

Acknowledgements

• The streaming functionality is largely based on this demo