SkyScraper
by JonCanning
An asynchronous web scraper / web crawler using async / await and Reactive Extensions
AI summary
Web scraper framework
A framework for building asynchronous web scrapers and crawlers using async/await and Reactive Extensions.
- stars
- 59
- forks
- 18
- watching
- 10
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Web scraper
A framework for automating web scraping and crawling tasks using Node.js
Web scraper
A framework for extracting structured data from web pages using CSS selectors.
howie6879/ruia1.8K
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
Web framework
A fast and asynchronous web framework built on top of Rust, removing boilerplate and decoupling HTTP concepts from application logic.
Crawler library
A high-level web crawling and scraping framework for Elixir.
Web framework
A lightweight Ruby web framework designed to support large applications with scalability and expressiveness.
Crawler framework
A Java framework for building web-based crawlers with features like distributed crawling and proxy support.
Web Crawler Framework
A minimalist web crawler framework built on top of miners and structure-based data extraction
Website scraper
A Node.js library and CLI for scraping websites using Puppeteer and YAML definitions
Web crawler
A framework for building fast and efficient web crawlers and scrapers in Go.
sly777/ran2.2K
Web framework
A full-stack React project using GraphQL and Next.js Toolkit for building fast and scalable web applications with built-in development tools.
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
wspl/creeper780
Crawler framework
A framework for building cross-platform web crawlers using Go
Web framework
A web framework and library that enables building client-side and server-side web applications with a simple, elegant, and Rust-based architecture.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions SkyScraper.
