demiurge
Scraping framework
An HTML scraping framework built on top of PyQuery.
PyQuery-based scraping micro-framework.
115 stars
11 watching
19 forks
Language: Python
last commit: about 3 years ago
Linked from 2 awesome lists
jobbole/awesome-python-cn
brucedone/awesome-crawlerRelated projects:
| Repository | Description | Stars |
|---|---|---|
 medialab/minet | A command line tool and Python library for extracting data from various web sources. | 293 |
 laramies/metagoofil | Extracts metadata from public documents found on websites, useful for brute-force attacks. | 1,050 |
 howie6879/ruia | An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling | 1,753 |
 propublica/upton | A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval | 1,612 |
 matschaffer/astley | A Bash-based web framework for creating simple web applications with routing and template rendering capabilities. | 13 |
 vifreefly/kimuraframework | A web scraping framework for extracting data from JavaScript-rendered websites. | 1,010 |
 chaoss/grimoirelab-perceval | A tool to gather data from various software repositories | 293 |
 gushonorato/mechanize | A web scraping and automation tool for Elixir. | 30 |
 meilisearch/docs-scraper | Automates scraping and indexing of documentation content into a search engine | 297 |
 davescodemusings/thimble | A lightweight web framework for MicroPython-based microcontrollers | 17 |
 malfrats/xeuledoc | A tool to fetch information about public Google documents from various services | 856 |
 mhhf/spore | A decentralized package manager for Ethereum-based dApp development | 85 |
 miguelgrinberg/microdot | A lightweight web framework for Python and MicroPython enabling the creation of small web applications | 1,550 |
 twisted/klein | A micro web framework built on top of Werkzeug and Twisted that provides a simple API for developing production-ready web services | 836 |
 miyagawa/web-scraper | A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface. | 104 |