Skip to content
AI-Lib

Introduction

Welcome to AI-Lib

Section titled “Welcome to AI-Lib”

AI-Lib is an open-source ecosystem that standardizes how applications interact with AI models. Instead of writing provider-specific code for each AI service, you use a single unified API — and protocol configuration handles the rest.

The Core Idea

Section titled “The Core Idea”

All logic is operators, all configuration is protocol.

Traditional AI SDKs embed provider-specific logic in code: different HTTP endpoints, different parameter names, different streaming formats, different error codes. When you switch providers, you rewrite code.

AI-Lib takes a different approach:

  • AI-Protocol defines how to talk to each provider in YAML manifests
  • Runtime implementations (Rust, Python) read these manifests and execute requests
  • Zero hardcoded logic — no if provider == "openai" branches anywhere

Three Projects, One Ecosystem

Section titled “Three Projects, One Ecosystem”
ProjectRoleLanguageDistribution
AI-ProtocolSpecification layerYAML/JSONGitHub
ai-lib-rustRuntime implementationRustCrates.io
ai-lib-pythonRuntime implementationPythonPyPI

AI-Protocol (Specification)

Section titled “AI-Protocol (Specification)”

The foundation. YAML manifests describe 30+ AI providers: their endpoints, authentication, parameter mappings, streaming decoder configurations, error classification rules, and capabilities. JSON Schema validates everything.

ai-lib-rust (Rust Runtime)

Section titled “ai-lib-rust (Rust Runtime)”

High-performance runtime. Operator-based streaming pipeline processes responses through composable stages (Decoder → Selector → Accumulator → EventMapper). Built-in resilience with circuit breaker, rate limiter, and backpressure. Published on Crates.io.

ai-lib-python (Python Runtime)

Section titled “ai-lib-python (Python Runtime)”

Developer-friendly runtime. Full async/await support, Pydantic v2 type safety, production-grade telemetry (OpenTelemetry + Prometheus), and intelligent model routing. Published on PyPI.

Key Features

Section titled “Key Features”
  • 30+ providers — OpenAI, Anthropic, Gemini, DeepSeek, Qwen, and many more
  • Unified streaming — Same StreamingEvent types regardless of provider
  • Protocol-driven — All behavior defined in YAML, not code
  • Hot-reload — Update provider configs without restarting
  • Resilience — Circuit breaker, rate limiting, retry, fallback
  • Tool calling — Unified function calling across providers
  • Embeddings — Vector operations and similarity search
  • Type safety — Compile-time (Rust) and runtime (Pydantic) validation

Next Steps

Section titled “Next Steps”