django-dynamic-scraper

Spider manager

An app that allows you to manage Scrapy spiders through a Django admin interface.

Creating Scrapy scrapers via the Django admin interface

1k stars

76 watching

310 forks

Language: Python

last commit: about 3 years ago

djangopythonscraperscrapingscrapyspiderwebscraping

Backlinks from these awesome lists:

Repository	Description	Stars
spider-rs/spider	A tool for web data extraction and processing using Rust	1,234
timonweb/django-manage.py-anywhere	A tool to run Django manage.py commands from any directory of a project	34
zhuyingda/webster	A framework for automating web scraping and crawling tasks using Node.js	518
wikier/djubby	A Linked Data frontend for SPARQL endpoints in Django, providing an interface to access and manipulate data using standard web protocols.	18
postmodern/spidr	A Ruby web crawling library that provides flexible and customizable methods to crawl websites	809
scrapy/scrapely	A pure-python library for extracting structured data from HTML pages.	1,865
django-cms/django-filer	A file management application for Django that simplifies handling of files and images.	1,779
chenjiandongx/github-spider	A Python-based web crawler for scraping Github user and repository data.	264
django-haystack/pysolr	Provides a lightweight Python interface to interact with Apache Solr search engine	667
feng19/spider_man	A high-level web crawling and scraping framework for Elixir.	23
jazzband/django-robots	A Django app for managing robots exclusion protocol files	459
spider/spider	A flexible graph database abstraction for PHP	23
elixir-crawly/crawly	A framework for extracting structured data from websites	994
its0x08/duckduckgo	A tool that scrapes search results from DuckDuckGo using Python	23
cobrateam/django-htmlmin	An HTML minifier tool for Python web frameworks to reduce data transferred and improve load times.	542