awesome/repos

#1,641 of 5,656 by stars

gocolly/colly

Elegant Scraper and Crawler Framework for Golang

Open on GitHubWebsiteOpen comparison
Stars
25,556
Forks
1,862
Created
9y ago
Last push
2d ago

Momentum

Per day
+4
Per 7 days
+6
Per 30 days
+38
Rank, 7 days
-8

Stars over time

25.5K25.5K25.5K25.5K25.6K25.6KSep 17Oct 5Oct 12Oct 19
View as table
DateStars
Sep 17, 202625,516
Oct 5, 202625,545
Oct 12, 202625,550
Oct 19, 202625,556

Understand this repo

Open it in a tool that explains, diagrams or digests the code.

Similar repositories

Ranked by how many distinctive topics they share with this one.

  1. 329

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    64.9K+131 7d12KPythontoday
  2. 4694

    A scalable web crawler framework for Java.

    11.7K0 7d4.1KJava10mo ago
  3. 3342

    newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

    15.2K+3 7d2.1KPythontoday
  4. 1576

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    26.2K+66 7d1.7KTypeScripttoday
  5. 1829

    Python ProxyPool for web spider

    23.8K+4 7d5.4KPython4mo ago
  6. 3973

    Incredibly fast crawler designed for OSINT.

    13.3K+22 7d1.7KPython2d ago