FlareSolverr: [yggtorrent] timeout caused by non-English system language

Have you checked our README?

  • I have checked the README

Have you followed our Troubleshooting?

  • I have followed your Troubleshooting

Is there already an issue for your problem?

  • I have checked older issues, open and closed

Have you checked the discussions?

  • I have read the Discussions

Environment

- FlareSolverr version: 3.3.6 (logs are for 3.3.6 but I got the same error with 3.3.7)
- Last working FlareSolverr version: 3.3.6
- Operating system: W10
- Are you using Docker: no
- FlareSolverr User-Agent : Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36
- Are you using a VPN: no
- Are you using a Proxy: no
- Are you using Captcha Solver: no
- If using captcha solver, which one:
- URL to test this issue: https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0

Description

Cloudflare Turnstile seems to find when FlareSolverr tries to pass the verification.

When doing some tests into no-headless mode, I saw FS marking the widget and the page reloading to the same verification page (wich is contradictory with the logs which display not finding the button “Verify you are human”).

After timeout (60 sec here but tried also with 600 sec), I got the error 500 (like already reported on some issues).

But I remark that if I manually click on the widget, CF Turnstile will let me go to the website (cf screenshot of the Chrome window.

Can we configure some longer delay to mark the widget to see if errors is occuring less than with the default delay ?

Logged Error Messages

2023-11-08 14:44:02 INFO     ReqId 13396 FlareSolverr 3.3.6
2023-11-08 14:44:02 DEBUG    ReqId 13396 Debug log enabled
2023-11-08 14:44:02 INFO     ReqId 13396 Testing web browser installation...
2023-11-08 14:44:02 INFO     ReqId 13396 Platform: Windows-10-10.0.19045-SP0
2023-11-08 14:44:02 INFO     ReqId 13396 Chrome / Chromium path: xxx\chrome.exe
2023-11-08 14:44:02 INFO     ReqId 13396 Chrome / Chromium major version: 115
2023-11-08 14:44:02 INFO     ReqId 13396 Launching web browser...
2023-11-08 14:44:02 DEBUG    ReqId 13396 Launching web browser...
2023-11-08 14:44:05 DEBUG    ReqId 13396 Started executable: `C:\Users\xxx\appdata\roaming\undetected_chromedriver\undetected_chromedriver.exe` in a child process with pid: 16180
2023-11-08 14:44:07 INFO     ReqId 13396 FlareSolverr User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36
2023-11-08 14:44:07 INFO     ReqId 13396 Test successful!
2023-11-08 14:44:07 INFO     ReqId 13396 Serving on http://0.0.0.0:8191
2023-11-08 14:44:11 INFO     ReqId 2972 Incoming request => POST /v1 body: {'cmd': 'sessions.create', 'session': 974}
2023-11-08 14:44:11 DEBUG    ReqId 2972 Creating new session...
2023-11-08 14:44:11 DEBUG    ReqId 2972 Launching web browser...
2023-11-08 14:44:12 DEBUG    ReqId 2972 Started executable: `C:\Users\xxx\appdata\roaming\undetected_chromedriver\chromedriver.exe` in a child process with pid: 17008
2023-11-08 14:44:13 DEBUG    ReqId 2972 Response => POST /v1 body: {'status': 'ok', 'message': 'Session created successfully.', 'session': 974, 'startTimestamp': 1699451051444, 'endTimestamp': 1699451053628, 'version': '3.3.6'}
2023-11-08 14:44:13 INFO     ReqId 2972 Response in 2.184 s
2023-11-08 14:44:13 INFO     ReqId 2972 127.0.0.1 POST http://localhost:8191/v1 200 OK
2023-11-08 14:44:16 INFO     ReqId 9768 Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0', 'maxTimeout': 60000, 'session': 974}
2023-11-08 14:44:16 DEBUG    ReqId 9768 existing session is used to perform the request (session_id=974, lifetime=0:00:02.690013, ttl=None)
2023-11-08 14:44:16 DEBUG    ReqId 10304 Navigating to... https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0
2023-11-08 14:44:16 INFO     ReqId 10304 Challenge detected. Selector found: #challenge-spinner
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for title (attempt 1): Just a moment...
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for title (attempt 1): DDoS-Guard
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for selector (attempt 1): #cf-challenge-running
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for selector (attempt 1): .ray_id
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for selector (attempt 1): .attack-box
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for selector (attempt 1): #cf-please-wait
2023-11-08 14:44:16 DEBUG    ReqId 10304 Waiting for selector (attempt 1): #challenge-spinner
2023-11-08 14:44:18 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:18 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:18 DEBUG    ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:44:18 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:18 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for title (attempt 2): Just a moment...
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for title (attempt 2): DDoS-Guard
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for selector (attempt 2): #cf-challenge-running
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for selector (attempt 2): .ray_id
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for selector (attempt 2): .attack-box
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for selector (attempt 2): #cf-please-wait
2023-11-08 14:44:20 DEBUG    ReqId 10304 Waiting for selector (attempt 2): #challenge-spinner
2023-11-08 14:44:21 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:21 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:31 DEBUG    ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:31 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:31 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for title (attempt 3): Just a moment...
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for title (attempt 3): DDoS-Guard
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for selector (attempt 3): #cf-challenge-running
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for selector (attempt 3): .ray_id
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for selector (attempt 3): .attack-box
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for selector (attempt 3): #cf-please-wait
2023-11-08 14:44:33 DEBUG    ReqId 10304 Waiting for selector (attempt 3): #challenge-spinner
2023-11-08 14:44:34 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:34 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:45 DEBUG    ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:45 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:45 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for title (attempt 4): Just a moment...
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for title (attempt 4): DDoS-Guard
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for selector (attempt 4): #cf-challenge-running
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for selector (attempt 4): .ray_id
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for selector (attempt 4): .attack-box
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for selector (attempt 4): #cf-please-wait
2023-11-08 14:44:47 DEBUG    ReqId 10304 Waiting for selector (attempt 4): #challenge-spinner
2023-11-08 14:44:48 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:48 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:54 DEBUG    ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:54 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:54 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for title (attempt 5): Just a moment...
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for title (attempt 5): DDoS-Guard
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for selector (attempt 5): #cf-challenge-running
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for selector (attempt 5): .ray_id
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for selector (attempt 5): .attack-box
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for selector (attempt 5): #cf-please-wait
2023-11-08 14:44:56 DEBUG    ReqId 10304 Waiting for selector (attempt 5): #challenge-spinner
2023-11-08 14:44:57 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:57 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:58 DEBUG    ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:44:58 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:58 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for title (attempt 6): Just a moment...
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for title (attempt 6): DDoS-Guard
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for selector (attempt 6): #cf-challenge-running
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for selector (attempt 6): .ray_id
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for selector (attempt 6): .attack-box
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for selector (attempt 6): #cf-please-wait
2023-11-08 14:45:00 DEBUG    ReqId 10304 Waiting for selector (attempt 6): #challenge-spinner
2023-11-08 14:45:01 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:01 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:01 DEBUG    ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:45:01 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:01 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for title (attempt 7): Just a moment...
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for title (attempt 7): DDoS-Guard
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for selector (attempt 7): #cf-challenge-running
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for selector (attempt 7): .ray_id
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for selector (attempt 7): .attack-box
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for selector (attempt 7): #cf-please-wait
2023-11-08 14:45:03 DEBUG    ReqId 10304 Waiting for selector (attempt 7): #challenge-spinner
2023-11-08 14:45:04 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:04 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:04 DEBUG    ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:04 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:04 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for title (attempt 8): Just a moment...
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for title (attempt 8): DDoS-Guard
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for selector (attempt 8): #cf-challenge-running
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for selector (attempt 8): .ray_id
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for selector (attempt 8): .attack-box
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for selector (attempt 8): #cf-please-wait
2023-11-08 14:45:06 DEBUG    ReqId 10304 Waiting for selector (attempt 8): #challenge-spinner
2023-11-08 14:45:07 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:07 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:07 DEBUG    ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:07 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:07 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for title (attempt 9): Just a moment...
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for title (attempt 9): DDoS-Guard
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for selector (attempt 9): #cf-challenge-running
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for selector (attempt 9): .ray_id
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for selector (attempt 9): .attack-box
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for selector (attempt 9): #cf-please-wait
2023-11-08 14:45:09 DEBUG    ReqId 10304 Waiting for selector (attempt 9): #challenge-spinner
2023-11-08 14:45:11 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:11 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:11 DEBUG    ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:11 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:11 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for title (attempt 10): Just a moment...
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for title (attempt 10): DDoS-Guard
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for selector (attempt 10): #cf-challenge-running
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for selector (attempt 10): .ray_id
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for selector (attempt 10): .attack-box
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for selector (attempt 10): #cf-please-wait
2023-11-08 14:45:13 DEBUG    ReqId 10304 Waiting for selector (attempt 10): #challenge-spinner
2023-11-08 14:45:14 DEBUG    ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:14 DEBUG    ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:14 DEBUG    ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:45:14 DEBUG    ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:14 DEBUG    ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:16 ERROR    ReqId 9768 Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-11-08 14:45:16 DEBUG    ReqId 9768 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1699451056318, 'endTimestamp': 1699451116439, 'version': '3.3.6'}
2023-11-08 14:45:16 INFO     ReqId 9768 Response in 60.121 s
2023-11-08 14:45:16 INFO     ReqId 9768 127.0.0.1 POST http://localhost:8191/v1 500 Internal Server Error

Screenshots

image

About this issue

  • Original URL
  • State: closed
  • Created 8 months ago
  • Comments: 37 (13 by maintainers)

Commits related to this issue

Most upvoted comments

v3.3.10

Use the new LANG environment variable - https://github.com/FlareSolverr/FlareSolverr#environment-variables

Specifically for YGGtorrent, if your system language isn’t already English, use an English language code, e.g. en_GB.

Maybe Chrome preferred language is not English and therefore The Cloudflare translating ‘Verify you are human’ to other language

I just added for myself in FlareSolverr/src/utils.py

122 options.add_argument(‘–lang=en_US’)

I’ve been looking for a solution for several months. I simply changed the Windows language and it works! Thank you very much for your help!

YGG seems to be performing some additional checks, I’m assuming it’s IP related. You could try a few proxy/VPN servers to see if it makes a difference. Both the request and FlareSolverr will require the same IP.

As I said previously, it’s not only IP related. It’s a part of the verification but not only.

With headless=false, I can manually pass the verification after FlareSolverr fails with a timeout. So after this, I can easily use FlareSolverr because it has passed the protection. But it needs a human interact and the goal is to make it undetecteable by Cloudflare. Cloudflare seems easily to find that the interaction by FlareSolverr is not human easily when a certain protection is activated.

Proof : https://github.com/FlareSolverr/FlareSolverr/assets/28442699/d1dee066-6a03-4ff2-8437-308a6145e2e9