sukhoi
by untwisted
Minimalist and powerful Web Crawler.
AI summary
Web Crawler Framework
A minimalist web crawler framework built on top of miners and structure-based data extraction
- stars
- 879
- forks
- 49
- watching
- 22
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Crawler framework
A distributed crawler framework that simplifies the process of building crawlers using Spring Boot and Redis
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
howie6879/ruia1.8K
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
Crawler framework
A Java framework for building web-based crawlers with features like distributed crawling and proxy support.
dyweb/scrala113
Web crawler framework
A web crawling framework written in Scala that allows users to define the start URL and parse response from it
Web framework
A lightweight Pythonic web development framework with modular and flexible application design.
Web scraper framework
A framework for building asynchronous web scrapers and crawlers using async/await and Reactive Extensions.
Web crawler
A simple command-line web crawler that automatically extracts links from web pages and can be run in parallel for efficient crawling
Web Crawler
A flexible web crawler that can be used to extract data from websites in a scalable and efficient manner
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Web Crawler
A versatile web crawler built with modern tools and concurrency to handle various crawl tasks
Web framework
A lightweight Python web framework with basic features for building small applications.
wspl/creeper780
Crawler framework
A framework for building cross-platform web crawlers using Go
Featured in 1 awesome list
Each link jumps to the spot where the list mentions sukhoi.
