portia

Web scraper

A visual scraping tool that extracts data from websites without requiring programming knowledge.

Visual scraping for Scrapy

9k stars

500 watching

1k forks

Language: Python

last commit: over 2 years ago

Linked from 2 awesome lists

Backlinks from these awesome lists:

Related projects:

Repository	Description	Stars
scrapy/scrapy	A fast high-level framework for extracting structured data from websites	53,484
ionicabizau/scrape-it	A Node.js library and CLI tool for automating web page scraping and parsing	4,024
propublica/upton	A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval	1,612
ruipgil/scraperjs	A versatile web scraping module with two scrapers for static and dynamic content extraction.	3,714
spatie/crawler	A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.	2,552
howie6879/ruia	An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling	1,753
vinitshahdeo/portscanner	A tool for scanning network ports to identify open connections	133
spekulatius/phpscraper	A web scraping utility for PHP that simplifies the process of extracting information from websites.	544
azubieta/appimages.scraper	A tool to extract AppImage release data from web pages	11
holgerd77/django-dynamic-scraper	An app that allows you to manage Scrapy spiders through a Django admin interface.	1,155
benibela/xidel	A tool to extract data from web pages using various query languages and selectors.	690
telstrapurple/purpleexplorer	An Azure Service Bus explorer tool for desktop applications	165
my8100/scrapydweb	A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results.	3,180
portainer/portainer	A single container application for managing Docker and Kubernetes environments through a GUI and/or extensive API	31,343
apify/crawlee	A tool for building reliable web scraping and browser automation pipelines in Node.js.	16,081