ruia
by howie6879
Async Python 3.6+ web scraping micro-framework based on asyncio
AI summary
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
- stars
- 1.8K
- forks
- 180
- watching
- 42
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
dyweb/scrala113
Web crawler framework
A web crawling framework written in Scala that allows users to define the start URL and parse response from it
Crawler library
A high-level web crawling and scraping framework for Elixir.
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Spider
A framework for extracting structured data from websites
spider-rs/spider1.2K
Web scraper
A tool for web data extraction and processing using Rust
Crawler
A modular, concurrent web crawler framework written in Go.
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Web scraper
A framework for automating web scraping and crawling tasks using Node.js
Web Crawler Framework
A minimalist web crawler framework built on top of miners and structure-based data extraction
Web crawler
A web crawler designed to backup websites by recursively crawling and writing WARC files.
Web scraper framework
A framework for building asynchronous web scrapers and crawlers using async/await and Reactive Extensions.
qinxuye/cola1.5K
Crawler library
A high-level framework for building distributed data extractors from web pages
Crawler framework
A distributed crawler framework that simplifies the process of building crawlers using Spring Boot and Redis
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions ruia.
