Awesome Lists

scrapy-redis

by rmax

Pythonpushed about 2 years ago

Redis-based components for Scrapy.

AI summary

Crawler helper

Provides Redis-based components for distributed crawling and post-processing in Scrapy

stars
5.5K
forks
1.6K
watching
273
awesome list
1
View on GitHubscrapy-redis.readthedocs.io

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/rmax/scrapy-redis/links.svg)](https://awesome.facts.dev/awesome/rmax/scrapy-redis)
HTML
<a href="https://awesome.facts.dev/awesome/rmax/scrapy-redis"><img src="https://awesome.facts.dev/shield/rmax/scrapy-redis/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/rmax/scrapy-redis/links.svg

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.