awesome-web-scraping
Web scraper resource list
A curated collection of tools and resources for web scraping and data processing
List of libraries, tools and APIs for web scraping and data processing.
7k stars
232 watching
791 forks
Language: Makefile
last commit: almost 2 years ago
Linked from 3 awesome lists
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
Awesome Web Scraping / Topics | |||
| Python | 6,771 | almost 2 years ago | Python packages |
| PHP | 6,771 | almost 2 years ago | PHP packages |
| Ruby | 6,771 | almost 2 years ago | Ruby packages |
| JavaScript | 6,771 | almost 2 years ago | JavaScript packages |
| Go | 6,771 | almost 2 years ago | Go packages |
| Command Line Tools | 6,771 | almost 2 years ago | tools with a command line interface |
| Web Scraping Manuals | 6,771 | almost 2 years ago | list of articles and books teaching web scraping |
| dhamaniasad / HeadlessBrowsers | 6,261 | about 2 years ago | list of (almost) all headless web browsers in existence |
| DNS over HTTPS providers | 36,309 | over 1 year ago | list of DNS over HTTPs providers |
| Awesome Pastebins | 171 | almost 2 years ago | list of pastebin sites |
Awesome Web Scraping / Captcha Solving Services | |||
| https://2captcha.com | |||
Awesome Web Scraping / Proxy Server Marketplaces | |||
| https://www.blackhatworld.com/forums/proxies-for-sale.112/ | |||
| https://forum.antichat.com/forums/147/ | |||
Awesome Web Scraping / Telegram Discussion Groups | |||
| @grablab | talks in English | ||
| @grablab_ru | talks in Russian | ||
jnv/lists
angrykoala/awesome-browser-automation
octaltree/playwright-rust
playwright-community/playwright-go
mkoehnke/wkzombie
phimage/erik
ngtcp2/nghttp3
openfluid/openfluid
garris/backstopjs
hardkoded/puppeteer-sharp
3rd/image.nvim
n0tan3rd/node-warc
liameno/librengine
simdsoft/1kiss
clickhouse/ch-bench