spider_man
by feng19
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.
AI summary
Crawler library
A high-level web crawling and scraping framework for Elixir.
- stars
- 23
- forks
- 4
- watching
- 4
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Spider
A framework for extracting structured data from websites
Crawler
A high-performance web crawling and scraping solution with customizable settings and worker pooling.
Crawler
A modular, concurrent web crawler framework written in Go.
Crawler library
A Ruby web crawling library that provides flexible and customizable methods to crawl websites
crawler
An Erlang-based web crawler designed to be scalable and highly configurable
Crawler
A Python-based web crawler for scraping Github user and repository data.
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
spider-rs/spider1.2K
Web scraper
A tool for web data extraction and processing using Rust
howie6879/ruia1.8K
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
Web crawler
A framework for building fast and efficient web crawlers and scrapers in Go.
Crawler library
A web crawling library for .NET that allows customizable crawling and throttling of websites.
qinxuye/cola1.5K
Crawler library
A high-level framework for building distributed data extractors from web pages
dyweb/scrala113
Web crawler framework
A web crawling framework written in Scala that allows users to define the start URL and parse response from it
Scraper
A web scraping and automation tool for Elixir.
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions spider_man.
