pspider
by hightman
纯 PHP 开发的并行抓取工具 (Parallel web crawler written in PHP)
AI summary
Web crawler
A parallel web crawler framework built using PHP and MySQLi
- stars
- 266
- forks
- 110
- watching
- 41
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
xianhu/pspider1.8K
Web Crawler Framework
A Python web crawler framework with support for multi-threading and proxy usage.
Web Crawler
A Python-based tool for web crawling and data collection from various websites
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Web Crawler
A flexible PHP web crawler with configurable traversal algorithms and filters.
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Web Crawler
A high-performance web crawler built on Apache Spark that fetches and analyzes web resources in real-time.
Crawler library
A Ruby web crawling library that provides flexible and customizable methods to crawl websites
Web Crawler
A flexible web crawler that can be used to extract data from websites in a scalable and efficient manner
Web crawler
A simple command-line web crawler that automatically extracts links from web pages and can be run in parallel for efficient crawling
Web Crawler
A versatile web crawler built with modern tools and concurrency to handle various crawl tasks
hominee/dyer135
Web crawler
A fast and flexible web crawling tool with features like asynchronous I/O and event-driven design.
Web scraper
A Scala-based DSL for programmatically accessing and interacting with web pages
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
crawler framework
A PHP framework for building distributed web crawlers with modular design and extensibility
wspl/creeper780
Crawler framework
A framework for building cross-platform web crawlers using Go
Featured in 1 awesome list
Each link jumps to the spot where the list mentions pspider.
