awesome-web-scraping
Web scraper resource list
A curated collection of tools and resources for web scraping and data processing
List of libraries, tools and APIs for web scraping and data processing.
7k stars
230 watching
787 forks
Language: Makefile
last commit: 27 days ago
Linked from 3 awesome lists
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
Awesome Web Scraping / Topics | |||
| Python | 6,707 | 27 days ago | Python packages |
| PHP | 6,707 | 27 days ago | PHP packages |
| Ruby | 6,707 | 27 days ago | Ruby packages |
| JavaScript | 6,707 | 27 days ago | JavaScript packages |
| Go | 6,707 | 27 days ago | Go packages |
| Command Line Tools | 6,707 | 27 days ago | tools with a command line interface |
| Web Scraping Manuals | 6,707 | 27 days ago | list of articles and books teaching web scraping |
| dhamaniasad / HeadlessBrowsers | 6,242 | 5 months ago | list of (almost) all headless web browsers in existence |
| DNS over HTTPS providers | 35,947 | 6 days ago | list of DNS over HTTPs providers |
| Awesome Pastebins | 166 | 5 days ago | list of pastebin sites |
Awesome Web Scraping / Captcha Solving Services | |||
| https://2captcha.com | |||
Awesome Web Scraping / Proxy Server Marketplaces | |||
| https://www.blackhatworld.com/forums/proxies-for-sale.112/ | |||
| https://forum.antichat.com/forums/147/ | |||
Awesome Web Scraping / Telegram Discussion Groups | |||
| @grablab | talks in English | ||
| @grablab_ru | talks in Russian | ||
jnv/lists
angrykoala/awesome-browser-automation
octaltree/playwright-rust
playwright-community/playwright-go
mkoehnke/wkzombie
phimage/erik
ngtcp2/nghttp3
openfluid/openfluid
garris/backstopjs
hardkoded/puppeteer-sharp
3rd/image.nvim
n0tan3rd/node-warc
liameno/librengine
simdsoft/1kiss
clickhouse/ch-bench