LiteLLM

ATR ACTIVE BREAKOUT

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

anthropic
langchain
llm
llmops
openai
ai-gateway

stars 52k

last activity today

open issues 1k

language Python

license Other

latest release saml-sso-e2e-demo-v1

momentum · per month since covered + 4k/mo (+9%/mo) · + 6k total since PR#34

metrics as of today

star history

Exact curve on star-history.com ↗

PR#34 46k★ 2026-05-20
now 52k★ + 6k since first covered

curve is sampled from GitHub's star history; the dashed stretch is before we first covered it, the solid line since. figures at coverage are the numbers we printed then (approx.), current count is live.

covered in

PR#34 2026-05-20 above the radar

The OSS AI gateway that stays independent post-Portkey

// comments

COMING SOON