cloudflare-scrape

Anti-bot helper

A tool to bypass Cloudflare's anti-bot page and access protected websites

A Python module to bypass Cloudflare's anti-bot page.

GitHub

3k stars
129 watching
462 forks
Language: Python
last commit: about 1 year ago
Linked from 1 awesome list

anti-bot-pagecloudflareprotected-pagescrapescraping-websites

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
sukkaw/cloudflare-block-bad-bot-ruleset Protects websites from malicious crawlers and bots by filtering out suspicious traffic based on user-agent information 209
christophetd/cloudflair A tool to identify vulnerable websites behind CloudFlare by analyzing Internet-wide scan data from Censys 2,618
ionicabizau/scrape-it A Node.js library and CLI tool for automating web page scraping and parsing 4,012
flaresolverr/flaresolverr A proxy server to bypass Cloudflare protection by solving Cloudflare challenges 7,837
finic-ai/finic Provides cloud-hosted browsers for automation and scraping tasks to avoid detection by websites. 2,296
cloudflare/cloudflared A client tool for setting up and managing secure tunneling between the Cloudflare network and external origins. 9,297
digitaloptimizationgroup/cloudflare-edge-proxy A Cloudflare worker script for enabling A/B testing and canary releases across multiple backends. 73
ruipgil/scraperjs A versatile web scraping module with two scrapers for static and dynamic content extraction. 3,710
prosopo/captcha Protects websites from bots and automated abuse by solving a challenge without collecting user data 48
nathanwaters/hasura-cloudflare-worker A Cloudflare Worker that uses Facebook-based authorization and GraphQL proxy queries with Hasura 18
m0rtem/cloudfail Reconnaissance tool that gathers information about a Cloudflare-protected target to discover its server location using misconfigured DNS and old database records. 2,237
k4m4/cloudflare-detect Detects whether a website is running behind Cloudflare 23
dommmel/cloudflare-workers-basic-auth Protects static HTML pages by authenticating incoming requests with a username and password 110
apify/crawlee A tool for building reliable web scraping and browser automation pipelines in Node.js. 15,604
justanotherarchivist/snscrape A Python-based social media scraper that extracts data from various platforms. 4,490