cloudflare-scrape

Anti-bot helper

A tool to bypass Cloudflare's anti-bot page and access protected websites

A Python module to bypass Cloudflare's anti-bot page.

GitHub

3k stars
129 watching
460 forks
Language: Python
last commit: over 1 year ago
Linked from 1 awesome list

anti-bot-pagecloudflareprotected-pagescrapescraping-websites

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
sukkaw/cloudflare-block-bad-bot-ruleset Protects websites from malicious crawlers and bots by filtering out suspicious traffic based on user-agent information 211
christophetd/cloudflair A tool to identify vulnerable websites behind CloudFlare by analyzing Internet-wide scan data from Censys 2,638
ionicabizau/scrape-it A Node.js library and CLI tool for automating web page scraping and parsing 4,024
flaresolverr/flaresolverr A proxy server to bypass Cloudflare protection by solving Cloudflare challenges 8,103
finic-ai/finic Provides cloud-hosted browsers for automation and scraping tasks to avoid detection by websites. 2,311
cloudflare/cloudflared A client tool for setting up and managing secure tunneling between the Cloudflare network and external origins. 9,455
digitaloptimizationgroup/cloudflare-edge-proxy A Cloudflare worker script for enabling A/B testing and canary releases across multiple backends. 73
ruipgil/scraperjs A versatile web scraping module with two scrapers for static and dynamic content extraction. 3,714
prosopo/captcha Protects websites from bots and automated abuse by solving a challenge without collecting user data 50
nathanwaters/hasura-cloudflare-worker A Cloudflare Worker that uses Facebook-based authorization and GraphQL proxy queries with Hasura 18
m0rtem/cloudfail Reconnaissance tool that gathers information about a Cloudflare-protected target to discover its server location using misconfigured DNS and old database records. 2,251
k4m4/cloudflare-detect Detects whether a website is running behind Cloudflare 23
dommmel/cloudflare-workers-basic-auth Protects static HTML pages by authenticating incoming requests with a username and password 111
apify/crawlee A tool for building reliable web scraping and browser automation pipelines in Node.js. 16,081
justanotherarchivist/snscrape A Python-based social media scraper that extracts data from various platforms. 4,557