2 releases
0.1.0 | May 5, 2023 |
---|
#2245 in Parser implementations
131 downloads per month
55KB
154 lines
jawohl
jawohl
is a Rust library that helps you deal with JSON produced by Large Language Models (LLM's).
jawohl
can complete an partial JSON string by automatically adding the missing closing characters (quotes, braces, and brackets). This is particularly useful when you're dealing with streaming JSON strings from LLM's and want to display information without waiting for the inference process to finish.
Features
- Automatically completes incomplete JSON strings
- Handles nested objects and arrays
- Handles escaped characters inside strings
- Returns an error for malformed JSON input
- soon wrappers published for Javascript and Python
Installation
Add the following line to your Cargo.toml file under the [dependencies] section:
jawohl = "0.1.0"
Usage
Here's a basic example showing how to use the JSON Completer library:
use jawohl::complete_json;
fn main() {
let input = r#"{"key": "value", "arr": [1, 2, {"nested_key": "nested_value""#;
assert!(complete_json(input), Ok(r#"{"key": "value", "arr": [1, 2, {"nested_key": "nested_value"}]}"#));
}
For more examples and advanced usage, refer to the examples directory. In particular, the OpenAI Streaming Parse example shows how to use jawohl to parse a stream of JSON data from OpenAI's API (using 64bit's async-openai library).
Running Tests
To run the test suite, run the following command from the root of the repository:
cargo test
This will execute a series of tests covering various scenarios, including nested objects and arrays, escaped quotes, and malformed JSON strings.
Contributing
We welcome contributions! If you'd like to contribute, please follow these steps:
- Fork the repository on GitHub
- Create a new branch for your feature or bugfix
- Commit your changes and push the branch to your fork
- Create a pull request against the main repository
Please ensure that your code follows Rust's best practices and includes tests for any new functionality or bugfixes.
Motivaiton
jawohl
was inspired by the untruncate-json library. We wanted to create a simpler version of untruncate-json
that was specifically designed for JSON produced by LLM's. jawohl
will not fix all partial json strings like how untruncate-json
will, but it will fix the most common cases. jawohl
is meant to be useful for displaying partial JSON strings from LLM's in a web browser, terminal, or other UI, where you want to display the JSON as it's being generated, without waiting for the inference process to finish and it's not that important that you have to be able to parse the JSON for each token, just for some of them. Additionally, we wanted to write it in Rust so that it could be used in other languages like Python and Javascript.
License
This project is licensed under the MIT License.