demiurge

Scraping framework

An HTML scraping framework built on top of PyQuery.

PyQuery-based scraping micro-framework.

GitHub

114 stars
11 watching
19 forks
Language: Python
last commit: almost 3 years ago
Linked from 2 awesome lists


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
medialab/minet A command line tool and Python library for extracting data from various web sources. 286
laramies/metagoofil Extracts metadata from public documents available on websites 1,028
howie6879/ruia An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling 1,752
propublica/upton A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval 1,613
matschaffer/astley A Bash-based web framework for creating simple web applications with routing and template rendering capabilities. 13
vifreefly/kimuraframework A web scraping framework for extracting data from JavaScript-rendered websites. 1,014
chaoss/grimoirelab-perceval A tool to gather data from various software repositories 290
gushonorato/mechanize A web scraping and automation tool for Elixir. 30
meilisearch/docs-scraper Automates scraping and indexing of documentation content into a search engine 290
davescodemusings/thimble A lightweight web framework for MicroPython-based microcontrollers 17
malfrats/xeuledoc A tool to fetch information about public Google documents from various services 846
mhhf/spore A decentralized package manager for Ethereum-based dApp development 85
miguelgrinberg/microdot A lightweight web framework for Python and MicroPython enabling the creation of small web applications 1,522
twisted/klein A micro web framework built on top of Werkzeug and Twisted that provides a simple API for developing production-ready web services 835
miyagawa/web-scraper A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface. 104