Best Method to Bypass Cloudflare & Captcha Bypass for Scraping

[RifHut]

Tested on 02/12/2024

Step 1: Install Python Library

1. Download the required Python library from the GitHub repository:
   sarperavci/CloudflareBypassForScraping.
2. Install the server dependencies by running:

   pip install -r server-requirements.txt
   

---

Step 2: Run the Server

Start the server using the following command:

python server.py

---

Step 3: Download the POC Configuration

Get the proof-of-concept (POC) configuration file:
bypasser.opk (439.3 KB)

or use this method :

Best Method to Bypass Cloudflare & Captcha Bypass for Scraping

To Avoid Parsing Cookies everytime, u can simply use this code to parse the cookies, convert them to a dict and then use them with the request Namespaces Newtonsoft.Json System.Collections.Generic Code BLOCK:Parse input = @data.SOURCE suffix = "}" leftDelim = "{\"cookies\":" rightDelim = "}," MODE:LR => VAR @co ENDBLOCK string jsonString = $"{co}"; var cookies = JsonConvert.DeserializeObject<Dictionary<string, string>>(jsonString); BLOCK:Parse LABEL:userAgent input = @data.S…

---

Preview:

[Mrx001]

To Avoid Parsing Cookies everytime, u can simply use this code to parse the cookies, convert them to a dict and then use them with the request

Namespaces

Newtonsoft.Json
System.Collections.Generic

Code

BLOCK:Parse
  input = @data.SOURCE
  suffix = "}"
  leftDelim = "{\"cookies\":"
  rightDelim = "},"
  MODE:LR
  => VAR @co
ENDBLOCK



string jsonString = $"{co}";
var cookies = JsonConvert.DeserializeObject<Dictionary<string, string>>(jsonString);
BLOCK:Parse
LABEL:userAgent
  input = @data.SOURCE
  jToken = "$.user_agent"
  MODE:Json
  => CAP @userAgent
ENDBLOCK

BLOCK:HttpRequest
LABEL:use cf_clearance
  url = "https://example.com"
  customCookies = @cookies
  customHeaders = ${("User-Agent", "<userAgent>"), ("Pragma", "no-cache"), ("Accept", "*/*"), ("Accept-Language", "en-US,en;q=0.8")}
  TYPE:STANDARD
  $""
  "application/x-www-form-urlencoded"
ENDBLOCK

[percebal42]

@Mrx001

Namespaces

Newtonsoft.Json
System.Collections.Generic

any way to can we use whit proxys ? .

[Mrx001]

yes you can, just use systemNet instead of rurilibhttp

[RifHut]

Thank you, @Mrx001!
I truly appreciate your feedback; your method is the best

[ByTomili]

@Mrx001 Please tell me how to solve the problem?

[RifHut]

Share with me your config

[Kirito]

I cannot obtain the value of cf_clearance.

[goldrake]

with GET got no error but with POST got error, i got this error

{"detail":"Not Found"}

[Marawan2003]

can it be done in headless mode without opening chrome ?

[abhinav21]

I Dont think its still working

[amg1p]

thank you broda ( work fine )