1 unstable release

Uses new Rust 2024

new 0.4.3 Mar 18, 2025

#32 in Magic Beans


Used in alith

Apache-2.0

400KB
9K SLoC

Alith Logo

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents for Everyone

Introduction

Alith is an AI agent framework designed for the Web3 and Crypto, empowering developers to quickly build, deploy, and manage on-chain AI agents. By integrating blockchain technology, AI/ML models, and developer-friendly tools, Alith provides a modular and extensible platform that supports AI bots, multi-chain interactions, smart contract operations, real-time data processing, and high-performance inference. Whether you're building DeFi trading bots, NFT analyzers, or DAO governance tools, Alith offers robust support for your projects. For more introduction and comparison, see our website.

Features

  • Multiple Model Support: Support for small models and large language models e.g., Llama, Grok, OpenAI, Anthropic, etc.
  • Highly Extensible: From covering internal prompts to accessing low-level APIs. Customize roles, goals, tools, actions and behaviors while maintaining a clean abstraction.
  • Workflow Support: Implementing any workflow pattern through processes - from simple sequential and hierarchical processes to complex custom orchestration patterns with conditional branching and parallel execution.
  • Cross-Language Support: Provides SDKs for Rust, Python and Node.js, making it easily accessible to different developers.
  • High-Performance Inference: Leverage the performance advantages of Rust and quick model inference technologies including graph optimization, model compression, JIT/AOT compilation with GPU coprocessors, etc.
  • Web3 Friendly and Secure: Out-of-the-box Web3 plugin allows developers to easily and securely integrate blockchain capabilities into TEE-based AI agent frameworks and their applications.

Architecture

Alith Arch

Quick Start

See documents here.

Contributing

We warmly welcome contributions to Alith! Whether you're a developer, a user reporting a bug, or someone eager to enhance our documentation, your participation is highly valued!

Contact

Follow our X/Twitter and join our Telegram.

License

Apache 2.0

Dependencies

~84–120MB
~2M SLoC