awesome-web-scraping
Web scraper resource list
A curated collection of tools and resources for web scraping and data processing
List of libraries, tools and APIs for web scraping and data processing.
7k stars
232 watching
791 forks
Language: Makefile
last commit: about 1 year ago
Linked from 3 awesome lists
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
Awesome Web Scraping / Topics | |||
| Python | 6,771 | about 1 year ago | Python packages |
| PHP | 6,771 | about 1 year ago | PHP packages |
| Ruby | 6,771 | about 1 year ago | Ruby packages |
| JavaScript | 6,771 | about 1 year ago | JavaScript packages |
| Go | 6,771 | about 1 year ago | Go packages |
| Command Line Tools | 6,771 | about 1 year ago | tools with a command line interface |
| Web Scraping Manuals | 6,771 | about 1 year ago | list of articles and books teaching web scraping |
| dhamaniasad / HeadlessBrowsers | 6,261 | over 1 year ago | list of (almost) all headless web browsers in existence |
| DNS over HTTPS providers | 36,309 | 12 months ago | list of DNS over HTTPs providers |
| Awesome Pastebins | 171 | about 1 year ago | list of pastebin sites |
Awesome Web Scraping / Captcha Solving Services | |||
| https://2captcha.com | |||
Awesome Web Scraping / Proxy Server Marketplaces | |||
| https://www.blackhatworld.com/forums/proxies-for-sale.112/ | |||
| https://forum.antichat.com/forums/147/ | |||
Awesome Web Scraping / Telegram Discussion Groups | |||
| @grablab | talks in English | ||
| @grablab_ru | talks in Russian | ||
jnv/lists
angrykoala/awesome-browser-automation
octaltree/playwright-rust
playwright-community/playwright-go
mkoehnke/wkzombie
phimage/erik
ngtcp2/nghttp3
openfluid/openfluid
garris/backstopjs
hardkoded/puppeteer-sharp
3rd/image.nvim
n0tan3rd/node-warc
liameno/librengine
simdsoft/1kiss
clickhouse/ch-bench