LLM Link

🚀 A user-friendly LLM proxy service with built-in support for popular AI coding tools

LLM Link provides zero-configuration access to LLM providers through multiple API formats, with optimized built-in support for popular AI applications.

✨ Key Features

• 🎯 Application-Oriented: Built-in configurations for popular AI coding tools
• ⚡ Zero Configuration: One-command startup for common use cases
• 🔄 Multi-Protocol: Simultaneous OpenAI, Ollama, and Anthropic API support
• 🔀 9 LLM Providers: OpenAI, Anthropic, Zhipu, Aliyun, Volcengine, Tencent, Longcat, Moonshot, Ollama
• 📡 Dynamic Model Discovery: REST API to query all supported providers and models
• ** Hot-Reload Configuration**: Update API keys and switch providers without restart
• ** Production Ready**: Built with Rust for performance and reliability

🎯 Supported Applications

� Full Application Documentation →

� Quick Start

Installation

# Install from crates.io (Recommended)
cargo install llm-link

# Or via Homebrew (macOS)
brew tap lipish/llm-link && brew install llm-link

# Or via pip (macOS / Linux)
pip install pyllmlink

� Complete Installation Guide →

Basic Usage

# For Codex CLI
./llm-link --app codex-cli --api-key "your-auth-token"

# For Zed
./llm-link --app zed

# For Aider (using open-source models)
./llm-link --app aider --provider zhipu --model glm-4.6 --api-key "your-zhipu-key"

# For OpenHands
./llm-link --app openhands --provider anthropic --model claude-3-5-sonnet --api-key "your-anthropic-key"

📚 Detailed Configuration Guide →

📋 Help & Information

# List all supported applications
./llm-link --list-apps

# Get detailed setup guide for specific application
./llm-link --app-info aider

# List available models for a provider
./llm-link --provider zhipu --list-models

🌐 Protocol Mode

Use multiple protocols simultaneously for maximum flexibility:

./llm-link --protocols openai,ollama,anthropic --provider zhipu --model glm-4.6

� Protocol Mode Documentation →

🏗️ Architecture

┌─────────────────┐    ┌─────────────────┐    ┌─────────────────┐
│   AI Tools      │    │   LLM Link      │    │   LLM Providers │
│                 │    │                 │    │                 │
│ • Codex CLI     │───▶│ • Protocol      │───▶│ • OpenAI        │
│ • Zed IDE       │    │   Conversion    │    │ • Anthropic     │
│ • Aider         │    │ • Format        │    │ • Zhipu         │
│ • OpenHands     │    │   Adaptation    │    │ • Aliyun        │
└─────────────────┘    └─────────────────┘    └─────────────────┘

📚 Architecture Documentation →

🔧 Advanced Usage

Custom Configuration

# Custom port and host
./llm-link --app aider --provider zhipu --model glm-4.6 --port 8095 --host 0.0.0.0

# With authentication
./llm-link --app aider --provider zhipu --model glm-4.6 --auth-key "your-secret-token"

Environment Variables

# Provider API keys
export ZHIPU_API_KEY="your-zhipu-api-key"
export OPENAI_API_KEY="sk-xxx"
export ANTHROPIC_API_KEY="sk-ant-xxx"

# LLM Link authentication
export LLM_LINK_API_KEY="your-auth-token"

📚 Advanced Configuration →

🧪 Testing

# Test health endpoint
curl http://localhost:8090/health

# Test OpenAI API
curl -X POST http://localhost:8090/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer your-token" \
  -d '{"model": "glm-4.6", "messages": [{"role": "user", "content": "Hello!"}]}'

📚 Testing & Troubleshooting →

📚 Full Documentation

🌐 Complete Documentation Site →

• Getting Started - Installation and basic setup
• Application Guides - Detailed integration for each tool
• Configuration - Advanced configuration options
• Architecture - System design and internals
• API Reference - REST API documentation

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

• Documentation Site
• Crates.io
• GitHub Repository
• API Reference