awesome-web-scraping

Web scraper resource list

A curated collection of tools and resources for web scraping and data processing

List of libraries, tools and APIs for web scraping and data processing.

GitHub

7k stars
232 watching
791 forks
Language: Makefile
last commit: almost 2 years ago
Linked from 3 awesome lists

captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping

Awesome Web Scraping / Topics

Python6,771almost 2 years agoPython packages
PHP6,771almost 2 years agoPHP packages
Ruby6,771almost 2 years agoRuby packages
JavaScript6,771almost 2 years agoJavaScript packages
Go6,771almost 2 years agoGo packages
Command Line Tools6,771almost 2 years agotools with a command line interface
Web Scraping Manuals6,771almost 2 years agolist of articles and books teaching web scraping
dhamaniasad / HeadlessBrowsers6,261over 2 years agolist of (almost) all headless web browsers in existence
DNS over HTTPS providers36,309almost 2 years agolist of DNS over HTTPs providers
Awesome Pastebins171almost 2 years agolist of pastebin sites

Awesome Web Scraping / Captcha Solving Services

https://2captcha.com

Awesome Web Scraping / Proxy Server Marketplaces

https://www.blackhatworld.com/forums/proxies-for-sale.112/
https://forum.antichat.com/forums/147/

Awesome Web Scraping / Telegram Discussion Groups

@grablabtalks in English
@grablab_rutalks in Russian

Backlinks from these awesome lists:

More related projects: