Skip to content
repository radar

// category

Voice, Vision & Multimodal

Speech, audio, image, and video: text-to-speech, transcription, OCR, vision, diffusion, and multimodal models.

These are our picks, not a scrape of GitHub trending: every repo here is one we covered in Repository Radar because we thought it worth tracking. Ranked by stars, with live metrics and a get-it block on each.

21 repos in this category. Browse or filter the full archive → · Compare all categories →

// the space

21 repos, our 5th-largest category (Agents & Orchestration leads with 92). Combined they're up 90% since we covered them, 5th-fastest-growing of our 9 categories. They hold 683k stars, 2k contributors and 1M weekly downloads between them. Strength runs broad, not top-heavy: the median repo (20k stars) sits close to the 33k average. 9 are breaking out and 20 still actively shipping, and Python leads on language.

total

683k
stars tracked
#4 of 9
+323k
stars added since covered
#5 of 9
2k
contributors
#5 of 9
1M
weekly downloads
#6 of 9
449
commits / week
#6 of 9
9
breaking out
#4 of 9
20
still shipping
#4 of 9

per repo

20k
median stars
#7 of 9
+15k
stars added / repo
#5 of 9
+90%
growth since covered
#5 of 9
96
contributors / repo
#8 of 9
54k
downloads / repo
#7 of 9
21
commits / repo
#7 of 9
43%
% breaking out
#6 of 9
95%
% shipping
#5 of 9
🖼️Immich ACTIVE

immich-app/immich

High performance self-hosted photo and video management solution.

109k
+ 3k/mo (+4%/mo) since covered
TypeScript
product TypeScript AGPL-3.0 PR#20
📡RuView BREAKOUT ACTIVE

ruvnet/RuView

π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection, all without a single pixel of video.

87k
+ 12k/mo (+43%/mo) since covered
Rust
Rust MIT PR#29
💡PaddleOCR ACTIVE

PaddlePaddle/PaddleOCR

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

86k
+ 3k/mo (+4%/mo) since covered
Python
library Python Apache-2.0 PR#21
🎙️Real-Time-Voice-Cloning BREAKOUT ACTIVE

CorentinJ/Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time

60k
+ 6k/mo (+10237%/mo) since covered
Python
Python Other PR#17
🎙️VibeVoice BREAKOUT ACTIVE

microsoft/VibeVoice

Open-Source Frontier Voice AI

51k
+ 4k/mo (+68%/mo) since covered
Python
library Python MIT PR#16
👁️supervision ACTIVE

roboflow/supervision

We write your reusable computer vision tools. 💜

48k
+ 2k/mo (+6%/mo) since covered
Python
product Python MIT PR#37, PR#13
🎙️Voicebox BREAKOUT ACTIVE

jamiepine/voicebox

The open-source AI voice studio. Clone, dictate, create.

47k
+ 9k/mo (+50%/mo) since covered
TypeScript
product TypeScript MIT PR#32
🎬OpenMontage BREAKOUT ACTIVE

calesthio/OpenMontage

World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

43k
+ 14k/mo (+48%/mo) since covered
Python
Python AGPL-3.0 PR#37
🎙️meetily ACTIVE

Zackriya-Solutions/meetily

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

27k
Rust
product Rust MIT PR#38
🗣️Chatterbox BREAKOUT ACTIVE

resemble-ai/chatterbox

SoTA open-source TTS

26k
+ 1k/mo (+12%/mo) since covered
Python
library Python MIT PR#16
🎧ebook2audiobook ACTIVE

DrewThomasson/ebook2audiobook

Generate audiobooks from e-books, voice cloning & 1158+ languages!

20k
+ 521/mo (+3%/mo) since covered
Python
library Python Apache-2.0 PR#21
🎙️FunASR ACTIVE

modelscope/FunASR

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

20k
+ 622/mo (+6%/mo) since covered
Python
product Python MIT PR#7
✂️video-use BREAKOUT ACTIVE

browser-use/video-use

Edit videos with coding agents

18k
+ 6k/mo (+50%/mo) since covered
Python
Python MIT PR#37
🐱KittenTTS ACTIVE

KittenML/KittenTTS

State-of-the-art TTS model under 25MB 😻

15k
+ 850/mo (+8%/mo) since covered
Python
library Python Apache-2.0 PR#28
🎙️RealtimeSTT ACTIVE

KoljaB/RealtimeSTT

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

10k
+ 159/mo (+2%/mo) since covered
Python
Python MIT PR#11
🎙️dograh BREAKOUT ACTIVE

dograh-hq/dograh

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

5k
+ 3k/mo (+68764%/mo) since covered
Python
product Python BSD-2-Clause PR#35
🧬OmniGen2 ACTIVE

VectorSpaceLab/OmniGen2

OmniGen2: Exploration to Advanced Multimodal Generation. https://arxiv.org/abs/2506.18871

4k
+ 71/mo (+2%/mo) since covered
Jupyter Notebook
Jupyter Notebook Apache-2.0 PR#12
🎥Goku FAINT SIGNAL

Saiyan-World/goku

[CVPR2025 Highlight] Video Generation Foundation Models: https://saiyan-world.github.io/goku/

3k
+ 46/mo (+2%/mo) since covered
Python
Python PR#2
🖌️OmniSVG ACTIVE

OmniSVG/OmniSVG

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

3k
+ 88/mo (+7%/mo) since covered
Python
Python Apache-2.0 PR#6
Pruna BREAKOUT ACTIVE

PrunaAI/pruna

Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

1k
+ 64/mo (+32%/mo) since covered
Python
library Python Apache-2.0 PR#4
🕸️Magnitude ACTIVE

magnitudedev/magnitude

Magnitude coding agent

34
-240/mo (-8%/mo) since covered
TypeScript
TypeScript Apache-2.0 PR#12