colly
by gocolly
Elegant Scraper and Crawler Framework for Golang
AI summary
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
- stars
- 23.4K
- forks
- 1.8K
- watching
- 335
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
geziyor/geziyor2.6K
crawler
A fast and flexible web crawling and scraping framework for extracting structured data from websites.
Crawler
A tool for web crawling and exploitation written in Go.
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
gohugoio/hugo76.5K
Website generator
A fast and flexible tool for generating static websites with built-in support for various content formats.
Crawler
A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
Crawler
A modular, concurrent web crawler framework written in Go.
Crawler
A tool for automatically discovering and crawling web application endpoints and assets
scraper
A Node.js library and CLI tool for automating web page scraping and parsing
s0md3v/photon11.1K
Crawler
A fast and flexible web crawler designed to gather information from the internet
Scraper
A tool to scrape and store hierarchical data about GitHub organizations, users, or repositories.
Go linter
Automated code quality tool for Go programming language
Crawler
A concurrent web crawler written in Go that allows flexible and polite crawling of websites.
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
Scrapy cluster manager
A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions colly.
