webster

spider-rs/spider1.2K

Web scraper

A tool for web data extraction and processing using Rust

joseconstela/webparsy44

Website scraper

A Node.js library and CLI for scraping websites using Puppeteer and YAML definitions

yhat/scrape1.5K

Scraper

A collection of utility functions and tools to simplify web scraping in Go.

tjatse/node-readability343

Web scraper

Automates web page scraping and text extraction to make any webpage readable

benibela/xidel690

Web scraper

A tool to extract data from web pages using various query languages and selectors.

holgerd77/django-dynamic-scraper1.2K

Spider manager

An app that allows you to manage Scrapy spiders through a Django admin interface.

miyagawa/web-scraper104

HTML scraper

A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface.

joncanning/skyscraper59

Web scraper framework

A framework for building asynchronous web scrapers and crawlers using async/await and Reactive Extensions.

amoilanen/js-crawler254

Web crawler

A Node.js module for crawling web sites and scraping their content

howie6879/ruia1.8K

Crawler framework

An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling

scrapy/scrapely1.9K

HTML parser

A pure-python library for extracting structured data from HTML pages.

dyweb/scrala113

Web crawler framework

A web crawling framework written in Scala that allows users to define the start URL and parse response from it

tidyverse/rvest1.5K

Web scraper

A package for extracting data from web pages using HTML parsing and CSS/XPath selectors.

propublica/upton1.6K

Web scraper library

A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval

jakopako/goskyr36

Web scraper

A tool to simplify web scraping of list-like structured data from web pages