awesome-web-scraping
Web scraper resource list
A curated collection of tools and resources for web scraping and data processing
List of libraries, tools and APIs for web scraping and data processing.
7k stars
232 watching
791 forks
Language: Makefile
last commit: about 2 months ago
Linked from 3 awesome lists
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
Awesome Web Scraping / Topics | |||
| Python | 6,771 | about 2 months ago | Python packages |
| PHP | 6,771 | about 2 months ago | PHP packages |
| Ruby | 6,771 | about 2 months ago | Ruby packages |
| JavaScript | 6,771 | about 2 months ago | JavaScript packages |
| Go | 6,771 | about 2 months ago | Go packages |
| Command Line Tools | 6,771 | about 2 months ago | tools with a command line interface |
| Web Scraping Manuals | 6,771 | about 2 months ago | list of articles and books teaching web scraping |
| dhamaniasad / HeadlessBrowsers | 6,261 | 7 months ago | list of (almost) all headless web browsers in existence |
| DNS over HTTPS providers | 36,309 | about 1 month ago | list of DNS over HTTPs providers |
| Awesome Pastebins | 171 | about 2 months ago | list of pastebin sites |
Awesome Web Scraping / Captcha Solving Services | |||
| https://2captcha.com | |||
Awesome Web Scraping / Proxy Server Marketplaces | |||
| https://www.blackhatworld.com/forums/proxies-for-sale.112/ | |||
| https://forum.antichat.com/forums/147/ | |||
Awesome Web Scraping / Telegram Discussion Groups | |||
| @grablab | talks in English | ||
| @grablab_ru | talks in Russian | ||
jnv/lists
angrykoala/awesome-browser-automation
octaltree/playwright-rust
playwright-community/playwright-go
mkoehnke/wkzombie
phimage/erik
ngtcp2/nghttp3
openfluid/openfluid
garris/backstopjs
hardkoded/puppeteer-sharp
3rd/image.nvim
n0tan3rd/node-warc
liameno/librengine
simdsoft/1kiss
clickhouse/ch-bench