scrapy-redis
by rmax
Pythonpushed about 2 years ago
Redis-based components for Scrapy.
AI summary
Crawler helper
Provides Redis-based components for distributed crawling and post-processing in Scrapy
- stars
- 5.5K
- forks
- 1.6K
- watching
- 273
- awesome list
- 1
Featured in 1 awesome list
Each link jumps to the spot where the list mentions scrapy-redis.