FlareSolverr: [yggtorrent] timeout caused by non-English system language
Have you checked our README?
- I have checked the README
Have you followed our Troubleshooting?
- I have followed your Troubleshooting
Is there already an issue for your problem?
- I have checked older issues, open and closed
Have you checked the discussions?
- I have read the Discussions
Environment
- FlareSolverr version: 3.3.6 (logs are for 3.3.6 but I got the same error with 3.3.7)
- Last working FlareSolverr version: 3.3.6
- Operating system: W10
- Are you using Docker: no
- FlareSolverr User-Agent : Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36
- Are you using a VPN: no
- Are you using a Proxy: no
- Are you using Captcha Solver: no
- If using captcha solver, which one:
- URL to test this issue: https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0
Description
Cloudflare Turnstile seems to find when FlareSolverr tries to pass the verification.
When doing some tests into no-headless mode, I saw FS marking the widget and the page reloading to the same verification page (wich is contradictory with the logs which display not finding the button “Verify you are human”).
After timeout (60 sec here but tried also with 600 sec), I got the error 500
(like already reported on some issues).
But I remark that if I manually click on the widget, CF Turnstile will let me go to the website (cf screenshot of the Chrome window.
Can we configure some longer delay to mark the widget to see if errors is occuring less than with the default delay ?
Logged Error Messages
2023-11-08 14:44:02 INFO ReqId 13396 FlareSolverr 3.3.6
2023-11-08 14:44:02 DEBUG ReqId 13396 Debug log enabled
2023-11-08 14:44:02 INFO ReqId 13396 Testing web browser installation...
2023-11-08 14:44:02 INFO ReqId 13396 Platform: Windows-10-10.0.19045-SP0
2023-11-08 14:44:02 INFO ReqId 13396 Chrome / Chromium path: xxx\chrome.exe
2023-11-08 14:44:02 INFO ReqId 13396 Chrome / Chromium major version: 115
2023-11-08 14:44:02 INFO ReqId 13396 Launching web browser...
2023-11-08 14:44:02 DEBUG ReqId 13396 Launching web browser...
2023-11-08 14:44:05 DEBUG ReqId 13396 Started executable: `C:\Users\xxx\appdata\roaming\undetected_chromedriver\undetected_chromedriver.exe` in a child process with pid: 16180
2023-11-08 14:44:07 INFO ReqId 13396 FlareSolverr User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36
2023-11-08 14:44:07 INFO ReqId 13396 Test successful!
2023-11-08 14:44:07 INFO ReqId 13396 Serving on http://0.0.0.0:8191
2023-11-08 14:44:11 INFO ReqId 2972 Incoming request => POST /v1 body: {'cmd': 'sessions.create', 'session': 974}
2023-11-08 14:44:11 DEBUG ReqId 2972 Creating new session...
2023-11-08 14:44:11 DEBUG ReqId 2972 Launching web browser...
2023-11-08 14:44:12 DEBUG ReqId 2972 Started executable: `C:\Users\xxx\appdata\roaming\undetected_chromedriver\chromedriver.exe` in a child process with pid: 17008
2023-11-08 14:44:13 DEBUG ReqId 2972 Response => POST /v1 body: {'status': 'ok', 'message': 'Session created successfully.', 'session': 974, 'startTimestamp': 1699451051444, 'endTimestamp': 1699451053628, 'version': '3.3.6'}
2023-11-08 14:44:13 INFO ReqId 2972 Response in 2.184 s
2023-11-08 14:44:13 INFO ReqId 2972 127.0.0.1 POST http://localhost:8191/v1 200 OK
2023-11-08 14:44:16 INFO ReqId 9768 Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0', 'maxTimeout': 60000, 'session': 974}
2023-11-08 14:44:16 DEBUG ReqId 9768 existing session is used to perform the request (session_id=974, lifetime=0:00:02.690013, ttl=None)
2023-11-08 14:44:16 DEBUG ReqId 10304 Navigating to... https://www3.yggtorrent.wtf/engine/search?category=2145&sub_category=2183&option_qualite%5B0%5D=2&option_qualite%5B1%5D=3&option_qualite%5B2%5D=4&option_qualite%5B3%5D=8&option_qualite%5B4%5D=9&option_qualite%5B5%5D=12&option_qualite%5B6%5D=13&option_qualite%5B7%5D=17&option_qualite%5B8%5D=18&option_qualite%5B9%5D=21&option_qualite%5B10%5D=22&do=search&order=desc&sort=publish_date&page=0
2023-11-08 14:44:16 INFO ReqId 10304 Challenge detected. Selector found: #challenge-spinner
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for title (attempt 1): Just a moment...
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for title (attempt 1): DDoS-Guard
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for selector (attempt 1): #cf-challenge-running
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for selector (attempt 1): .ray_id
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for selector (attempt 1): .attack-box
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for selector (attempt 1): #cf-please-wait
2023-11-08 14:44:16 DEBUG ReqId 10304 Waiting for selector (attempt 1): #challenge-spinner
2023-11-08 14:44:18 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:18 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:18 DEBUG ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:44:18 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:18 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for title (attempt 2): Just a moment...
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for title (attempt 2): DDoS-Guard
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for selector (attempt 2): #cf-challenge-running
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for selector (attempt 2): .ray_id
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for selector (attempt 2): .attack-box
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for selector (attempt 2): #cf-please-wait
2023-11-08 14:44:20 DEBUG ReqId 10304 Waiting for selector (attempt 2): #challenge-spinner
2023-11-08 14:44:21 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:21 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:31 DEBUG ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:31 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:31 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for title (attempt 3): Just a moment...
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for title (attempt 3): DDoS-Guard
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for selector (attempt 3): #cf-challenge-running
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for selector (attempt 3): .ray_id
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for selector (attempt 3): .attack-box
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for selector (attempt 3): #cf-please-wait
2023-11-08 14:44:33 DEBUG ReqId 10304 Waiting for selector (attempt 3): #challenge-spinner
2023-11-08 14:44:34 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:34 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:45 DEBUG ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:45 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:45 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for title (attempt 4): Just a moment...
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for title (attempt 4): DDoS-Guard
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for selector (attempt 4): #cf-challenge-running
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for selector (attempt 4): .ray_id
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for selector (attempt 4): .attack-box
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for selector (attempt 4): #cf-please-wait
2023-11-08 14:44:47 DEBUG ReqId 10304 Waiting for selector (attempt 4): #challenge-spinner
2023-11-08 14:44:48 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:48 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:54 DEBUG ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:44:54 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:54 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for title (attempt 5): Just a moment...
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for title (attempt 5): DDoS-Guard
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for selector (attempt 5): #cf-challenge-running
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for selector (attempt 5): .ray_id
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for selector (attempt 5): .attack-box
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for selector (attempt 5): #cf-please-wait
2023-11-08 14:44:56 DEBUG ReqId 10304 Waiting for selector (attempt 5): #challenge-spinner
2023-11-08 14:44:57 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:44:57 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:44:58 DEBUG ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:44:58 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:44:58 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for title (attempt 6): Just a moment...
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for title (attempt 6): DDoS-Guard
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for selector (attempt 6): #cf-challenge-running
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for selector (attempt 6): .ray_id
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for selector (attempt 6): .attack-box
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for selector (attempt 6): #cf-please-wait
2023-11-08 14:45:00 DEBUG ReqId 10304 Waiting for selector (attempt 6): #challenge-spinner
2023-11-08 14:45:01 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:01 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:01 DEBUG ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:45:01 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:01 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for title (attempt 7): Just a moment...
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for title (attempt 7): DDoS-Guard
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for selector (attempt 7): #cf-challenge-running
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for selector (attempt 7): .ray_id
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for selector (attempt 7): .attack-box
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for selector (attempt 7): #cf-please-wait
2023-11-08 14:45:03 DEBUG ReqId 10304 Waiting for selector (attempt 7): #challenge-spinner
2023-11-08 14:45:04 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:04 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:04 DEBUG ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:04 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:04 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for title (attempt 8): Just a moment...
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for title (attempt 8): DDoS-Guard
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for selector (attempt 8): #cf-challenge-running
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for selector (attempt 8): .ray_id
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for selector (attempt 8): .attack-box
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for selector (attempt 8): #cf-please-wait
2023-11-08 14:45:06 DEBUG ReqId 10304 Waiting for selector (attempt 8): #challenge-spinner
2023-11-08 14:45:07 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:07 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:07 DEBUG ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:07 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:07 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for title (attempt 9): Just a moment...
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for title (attempt 9): DDoS-Guard
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for selector (attempt 9): #cf-challenge-running
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for selector (attempt 9): .ray_id
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for selector (attempt 9): .attack-box
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for selector (attempt 9): #cf-please-wait
2023-11-08 14:45:09 DEBUG ReqId 10304 Waiting for selector (attempt 9): #challenge-spinner
2023-11-08 14:45:11 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:11 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:11 DEBUG ReqId 10304 Cloudflare verify checkbox not found on the page.
2023-11-08 14:45:11 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:11 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for title (attempt 10): Just a moment...
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for title (attempt 10): DDoS-Guard
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for selector (attempt 10): #cf-challenge-running
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for selector (attempt 10): .ray_id
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for selector (attempt 10): .attack-box
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for selector (attempt 10): #cf-please-wait
2023-11-08 14:45:13 DEBUG ReqId 10304 Waiting for selector (attempt 10): #challenge-spinner
2023-11-08 14:45:14 DEBUG ReqId 10304 Timeout waiting for selector
2023-11-08 14:45:14 DEBUG ReqId 10304 Try to find the Cloudflare verify checkbox...
2023-11-08 14:45:14 DEBUG ReqId 10304 Cloudflare verify checkbox found and clicked!
2023-11-08 14:45:14 DEBUG ReqId 10304 Try to find the Cloudflare 'Verify you are human' button...
2023-11-08 14:45:14 DEBUG ReqId 10304 The Cloudflare 'Verify you are human' button not found on the page.
2023-11-08 14:45:16 ERROR ReqId 9768 Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-11-08 14:45:16 DEBUG ReqId 9768 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1699451056318, 'endTimestamp': 1699451116439, 'version': '3.3.6'}
2023-11-08 14:45:16 INFO ReqId 9768 Response in 60.121 s
2023-11-08 14:45:16 INFO ReqId 9768 127.0.0.1 POST http://localhost:8191/v1 500 Internal Server Error
Screenshots
About this issue
- Original URL
- State: closed
- Created 8 months ago
- Comments: 37 (13 by maintainers)
Commits related to this issue
- Add LANG ENV. resolves #951 — committed to luisriverag/FlareSolverr by ilike2burnthing 8 months ago
v3.3.10
Use the new
LANG
environment variable - https://github.com/FlareSolverr/FlareSolverr#environment-variablesSpecifically for YGGtorrent, if your system language isn’t already English, use an English language code, e.g.
en_GB
.Maybe Chrome preferred language is not English and therefore The Cloudflare translating ‘Verify you are human’ to other language
I just added for myself in FlareSolverr/src/utils.py
122 options.add_argument(‘–lang=en_US’)
I’ve been looking for a solution for several months. I simply changed the Windows language and it works! Thank you very much for your help!
As I said previously, it’s not only IP related. It’s a part of the verification but not only.
With headless=false, I can manually pass the verification after FlareSolverr fails with a timeout. So after this, I can easily use FlareSolverr because it has passed the protection. But it needs a human interact and the goal is to make it undetecteable by Cloudflare. Cloudflare seems easily to find that the interaction by FlareSolverr is not human easily when a certain protection is activated.
Proof : https://github.com/FlareSolverr/FlareSolverr/assets/28442699/d1dee066-6a03-4ff2-8437-308a6145e2e9