awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

GitHub

7k stars
229 watching
785 forks
Language: Makefile
last commit: 17 days ago
Linked from 2 awesome lists

captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping

Awesome Web Scraping / Topics

Python 6,596 17 days ago Python packages
PHP 6,596 17 days ago PHP packages
Ruby 6,596 17 days ago Ruby packages
JavaScript 6,596 17 days ago JavaScript packages
Go 6,596 17 days ago Go packages
Web Scraping Manuals 6,596 17 days ago list of articles and books teaching web scraping
dhamaniasad / HeadlessBrowsers 6,204 3 months ago list of (almost) all headless web browsers in existence
DNS over HTTPS providers 35,407 12 days ago list of DNS over HTTPs providers
Awesome Pastebins 143 15 days ago list of pastebin sites

Awesome Web Scraping / Captcha Solving Services

https://2captcha.com

Awesome Web Scraping / Proxy Server Marketplaces

https://www.blackhatworld.com/forums/proxies-for-sale.112/
https://forum.antichat.com/forums/147/

Awesome Web Scraping / Telegram Discussion Groups

@grablab talks in English
@grablab_ru talks in Russian

Backlinks from these awesome lists: