awesome/repos

#364 of 5,656 by stars

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Open on GitHubWebsiteOpen comparison
Stars
61,552
Forks
12,472
Created
3y ago
Last push
today

Momentum

Per day
+87
Per 7 days
+503
Per 30 days
+2.5K
Rank, 7 days
+2

Stars over time

58K59K60K61K62KSep 17Oct 5Oct 12Oct 19
View as table
DateStars
Sep 17, 202658,910
Oct 5, 202660,147
Oct 12, 202661,049
Oct 19, 202661,552

Understand this repo

Open it in a tool that explains, diagrams or digests the code.

Similar repositories

Ranked by how many distinctive topics they share with this one.

  1. 4005

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    13.2K+48 7d1.5KTypeScript4mo ago
  2. 1182

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

    31.1K+392 7d6.2KJavaScript4d ago
  3. 636
    44.3K+21 7d5.2KLuatoday
  4. 224

    Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

    78.3K+2.8K 7d11.4KTypeScripttoday
  5. 3093

    Supercharge Your LLM Application Evaluations 🚀

    16.1K+70 7d1.9KPython7mo ago
  6. 5116

    Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

    10.9K+7 7d1.2KGotoday