creeper
by wspl
Creeper - The Next Generation Crawler Framework (Go)
AI summary
Crawler framework
A framework for building cross-platform web crawlers using Go
- stars
- 780
- forks
- 57
- watching
- 47
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Crawler
A modular, concurrent web crawler framework written in Go.
Web crawler
A framework for building fast and efficient web crawlers and scrapers in Go.
Crawler
A concurrent web crawler written in Go that allows flexible and polite crawling of websites.
Crawler framework
A distributed crawler framework that simplifies the process of building crawlers using Spring Boot and Redis
dyweb/scrala113
Web crawler framework
A web crawling framework written in Scala that allows users to define the start URL and parse response from it
Crawler
A distributed web crawler that coordinates crawling tasks across multiple worker processes using a message bus.
Crawler framework
A Java framework for building web-based crawlers with features like distributed crawling and proxy support.
Crawler library
A web crawling library for .NET that allows customizable crawling and throttling of websites.
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Link crawler
A tool to crawl websites by exploring links recursively with support for JavaScript rendering.
Crawler library
A Ruby web crawling library that provides flexible and customizable methods to crawl websites
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
Crawler library
A high-level web crawling and scraping framework for Elixir.
Web crawler
A web crawler designed to backup websites by recursively crawling and writing WARC files.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions creeper.
