#1,996 of 5,656 by stars
BuilderIO/gpt-crawler
Crawl a site to generate knowledge files to create your own custom GPT from a URL
- Stars
- 22,398
- Forks
- 2,349
- Created
- 2y ago
- Last push
- 1y ago
Momentum
- Per day
- -1
- Per 7 days
- +3
- Per 30 days
- 0
- Rank, 7 days
- -9
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 22,398 |
| Oct 5, 2026 | 22,403 |
| Oct 12, 2026 | 22,395 |
| Oct 19, 2026 | 22,398 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 146
- 4297
- 4150
- 4246
- 3888
- 4560
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.