scraping
12 repositories with 10k+ stars are tagged scraping.
Open in the explorer to search, filter and sort all of them.
- 1
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
- 2
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
- 3
Scrapy, a fast high-level web crawling & scraping framework for Python.
- 4
🕵️♂️ Collect a dossier on a person by username from 6K websites
- 5
- 6
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- 7
- 8
- 9
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
- 10
- 11
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
- 12
