cola
by qinxuye
A high-level distributed crawling framework.
AI summary
Crawler library
A high-level framework for building distributed data extractors from web pages
- stars
- 1.5K
- forks
- 537
- watching
- 166
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Crawler
A Python-based web crawler for scraping Github user and repository data.
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Crawler framework
A distributed crawler framework that simplifies the process of building crawlers using Spring Boot and Redis
Crawler library
A Rust-based library for building and managing cryptocurrency crawlers
Crawler library
A high-level web crawling and scraping framework for Elixir.
howie6879/ruia1.8K
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
Crawler library
A web crawling library for .NET that allows customizable crawling and throttling of websites.
crawler framework
A PHP framework for building distributed web crawlers with modular design and extensibility
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
Crawler
A modular, concurrent web crawler framework written in Go.
Spider
A framework for extracting structured data from websites
Crawler
A concurrent web crawler written in Go that allows flexible and polite crawling of websites.
felipecsl/wombat1.3K
Web scraper library
A Ruby-based web crawler and data extraction tool with an elegant DSL.
Crawler
A high-performance web crawling and scraping solution with customizable settings and worker pooling.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions cola.
