MSpider
by manning23
Spider
AI summary
Web Crawler
A Python-based tool for web crawling and data collection from various websites
- stars
- 348
- forks
- 191
- watching
- 55
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Web crawler
A simple command-line web crawler that automatically extracts links from web pages and can be run in parallel for efficient crawling
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Web crawler
A parallel web crawler framework built using PHP and MySQLi
Web Crawler
A flexible web crawler that can be used to extract data from websites in a scalable and efficient manner
Web scraper
A command line tool and Python library for extracting data from various web sources.
Web Crawler
A flexible PHP web crawler with configurable traversal algorithms and filters.
Crawler
A Python-based web crawler for scraping Github user and repository data.
Crawler library
A high-level web crawling and scraping framework for Elixir.
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
Crawler library
A Ruby web crawling library that provides flexible and customizable methods to crawl websites
spider-rs/spider1.2K
Web scraper
A tool for web data extraction and processing using Rust
Crawler
A distributed web crawler that coordinates crawling tasks across multiple worker processes using a message bus.
Web Spider Crawler
A cross-platform web spider/crawler tool for analyzing and mapping attack surfaces
Spider manager
An app that allows you to manage Scrapy spiders through a Django admin interface.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions MSpider.
