llmvm-codeassist

A LLM-powered code assistant that automatically retrieves context (i.e. type definitions) from a Language Server Protocol server. A frontend for llmvm.

Acts as a middleman between the code editor and the real LSP server. Uses the standard LSP specification for compatibility with various editors.

Only tested with the Helix editor and the Rust language server.

Features

• Code completion commands available in editor code actions menu
• Uses LSP to automatically gather type definitions for context
• Ability to manually add context for code completions
• Ability to select a model for code completion
• Code completion using multiple models simultaneously

Demo

Simple example using the editor code action menu:

Example generating multiple code completions, via multiple llmvm presets (using the ccpr= directive):

Manually adding context to code completion requests:

Quick start

Install this application using cargo.

cargo install llmvm-codeassist

The llmvm core must be installed. If you have not done so, the core may be installed via

cargo install llmvm-core

A backend must be installed and configured. The llmvm-outsource is recommended for OpenAI/HuggingFace/Ollama requests.

To install the outsource backend, run

cargo install llmvm-outsource

See Configuration in llmvm-outsource for configuring OpenAI/Ollama endpoints/API keys.

Currently, the default model preset is gpt-3.5-codegen which uses the outsource backend.

Usage

Your code editor must be configured to use llmvm-codeassist as the primary LSP server. The command for the real LSP language server must be appended to the arguments of llmvm-codeassist.

Here is an example of a Helix languages.toml configuration for the Rust language:

[language-server.llmvm-codeassist-rust]
command = "llmvm-codeassist"
args = ["rust-analyzer"]

[[language]]
name = "rust"
language-servers = [ "llmvm-codeassist-rust" ]

Code completion commands can be called by selecting uncompleted code, and invoking the code actions menu.

Selecting a model preset / multiple code generation requests

One or more llmvm model presets can be selected by providing the ccpr= directive in a code comment.

For example:

// ccpr=my-model-codegen

Multiple models can be selected by using a comma as a delimiter. See the second demo above for an example.

Manual context selection

Snippets of workspace code can be added to code generation requests manually, if need be. To do so, select the relevant snippet, invoke the code actions menu and select "Manually add...".

The snippet will be appended to the next code generation request.

Configuration

Run the codeassist executable to generate a configuration file at:

• Linux: ~/.config/llmvm/codeassist.toml.
• macOS: ~/Library/Application Support/com.djandries.llmvm/codeassist.toml
• Windows: AppData\Roaming\djandries\llmvm\config\codeassist.toml

Logging

Logs will be saved to the logs directory of the current llmvm project directory, or global user data directory.

The global logs directory is located at:

• Linux: ~/.local/share/llmvm/logs.
• macOS: ~/Library/Application Support/com.djandries.llmvm/logs
• Windows: AppData\Roaming\djandries\llmvm\data\logs

How it works

The code assistant forwards most LSP requests to the real LSP server, and hijacks/edits certain request or response payloads if they are relevant. The code action menu response is modified to show the code completion commands. Actual code completion commands sent by the user are handled by the code assistant, and are not sent to the real LSP server.

Requests are made to the LSP server to retrieve type definition information. Context is automatically retrieved by following this process:

1. Assistant asks LSP server for all symbol positions.
2. For each symbol, the assistant requests a type definition location.
3. A folding range is requested for each type definition location.
4. A text snippet is retrieved from the filesystem for each folding range.

License

Mozilla Public License, version 2.0