🧩TensorZero
tensorzero/tensorzero · homepage ↗
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
⭐ Very popular: 12k stars, gaining about 7 a week
View on GitHub ↗repo profile
momentum
durability
bus factor = how many people it takes to cover more than half the commits (6 months). 1 is a solo project; higher means the work is spread across a team. top-author share is the single busiest author's slice of those commits.
since we covered it
why it's a big deal
- Brings structure to the fragmented LLM ecosystem by offering a single, coherent stack instead of piecemeal tools.
- Turns production data and human feedback into a continuous learning cycle, making applications smarter over time.
- Demonstrates the momentum of OSS in AI, growing rapidly in adoption and community contributions.
under the hood
- Rust core with <1ms p99 latency at scale, paired with a Python SDK for accessibility.
- Modular design covering gateway, observability, optimization, evaluation, and experimentation, all usable incrementally.
- Fully self-hosted, GitOps-friendly, and OpenAI-compatible, supporting every major LLM provider with routing, retries, and fallbacks.
our take from PR#16, 2025-09-03
star history
curve is sampled from GitHub's star history, plus our own daily readings since we covered it; the dashed stretch is before we first covered it, the solid line since. figures at coverage are the numbers we printed then (approx.), current count is live.
understory
Output and attention are roughly in balance.
- output, commits & releases
- clout, star velocity
output = commits & releases; clout = star velocity, both 0 to 100 monthly indices; the gap where output runs above clout is the understory. The understory →
covered in
-
An Open Source Stack for Industrial Grade LLM Applications
-
The LLMOps Feedback Loop for Production AI Systems
similar projects
compare these →- 🦙 LLaMA-Factory
Python · 6.3× the stars
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
74k ACTIVE - ⚡ Unsloth
Python · 6.1× the stars
Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.
72k ACTIVE - ⌨ MLflow
Python · 2.3× the stars
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
28k ACTIVE
comments
Sign in with GitHub to add your blip on TensorZero.