#186 of 5,656 by stars
unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
- Stars
- 85,818
- Forks
- 8,924
- Created
- 2y ago
- Last push
- today
Momentum
- Per day
- +72
- Per 7 days
- +462
- Per 30 days
- +2K
- Rank, 7 days
- -1
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 83,687 |
| Oct 5, 2026 | 84,772 |
| Oct 12, 2026 | 85,356 |
| Oct 19, 2026 | 85,818 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 1576
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- 36
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
- 2374
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
- 1127
- 2909
- 183
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev