#1,576 of 5,656 by stars
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- Stars
- 26,189
- Forks
- 1,712
- Created
- 10y ago
- Last push
- today
Momentum
- Per day
- +8
- Per 7 days
- +66
- Per 30 days
- +352
- Rank, 7 days
- -6
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 25,814 |
| Oct 5, 2026 | 25,989 |
| Oct 12, 2026 | 26,123 |
| Oct 19, 2026 | 26,189 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 186
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
- 1641
- 329
Scrapy, a fast high-level web crawling & scraping framework for Python.
- 2666
Turn any website into a structured API. Extract, automate, search and monitor the web.
- 2374
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
- 36
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥