Skip to content
repository radar
Search & Research

🕸️Scrapegraph-ai

ACTIVE STEADY

ScrapeGraphAI/Scrapegraph-ai · homepage ↗

Python scraper based on AI

⭐ Very popular: 30k stars, gaining about 251 a week

View on GitHub ↗

repo profile

vintage 2024 2 years old
language Python
license MIT

momentum

total stars 30k
stars added last week +251
used by 618 repos & packages
commits / week 1 cooling · -75% vs prior mo
issues closed 100% ~32d to close, median
contributors 122
release cadence weekly
last activity 26d ago

durability

backing VC-backed ScrapeGraphAI (seed)
openness permissive
bus factor 2 concentrated
top-author share 31% 6 mo

bus factor = how many people it takes to cover more than half the commits (6 months). 1 is a solo project; higher means the work is spread across a team. top-author share is the single busiest author's slice of those commits.

since we covered it

monthly average + 633/mo (+3%/mo) · + 11k total since PR#3

why it's a big deal

  • Dramatically improves scraping accuracy through advanced contextual understanding.
  • Simplifies data extraction workflows by automating complex scraping tasks.
  • Enhances flexibility by supporting dynamic web content scraping.

under the hood

  • Built on robust LLM frameworks to interpret and analyse web page content.
  • Implements AI-driven decision-making to adaptively scrape complex pages.
  • Provides straightforward APIs for easy integration into existing data pipelines.

our take from PR#3, 2025-03-05

star history

PR#3 · 18k30k now Jan 2024Aug 2026
  1. PR#3 18k 2025-03-05
  2. now 30k + 11k since first covered

curve is sampled from GitHub's star history, plus our own daily readings since we covered it; the dashed stretch is before we first covered it, the solid line since. figures at coverage are the numbers we printed then (approx.), current count is live.

understory

Output and attention are roughly in balance.

-9 understory score output 65 · clout 74
Aug 2025 Jul 2026
  • output, commits & releases
  • clout, star velocity

output = commits & releases; clout = star velocity, both 0 to 100 monthly indices; the gap where output runs above clout is the understory. The understory →

covered in

  • PR#3 2025-03-05 on the radar

    Web Scraping Enhanced by LLMs

similar projects

compare these →
  • 🔥 Firecrawl

    TypeScript · 5.7× the stars · AGPL-3.0 licensed

    The context API to search, scrape, and interact with the web at scale. 🔥

    168k ACTIVE
  • 🕷️ Scrapling

    2.5× the stars

    🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

    74k ACTIVE
  • 🧠 Perplexica

    TypeScript

    Vane is an AI-powered answering engine.

    36k ACTIVE

replaces

alternatives to Apify →
  • Apify

    market leader

    closed source
  • Bright Data
    closed source
  • Diffbot
    closed source

comments

Sign in with GitHub to add your blip on Scrapegraph-ai.

loading comments…