FlareSolverr: I am getting 500 Internal Server Error In Response

Have you checked our README?

  • I have checked the README

Is there already an issue for your problem?

  • I have checked older issues, open and closed

Have you checked the discussions?

  • I have read the Discussions

Environment

- FlareSolverr version:3.0.2
- Last working FlareSolverr version: None
- Operating system: Windows 10
- Are you using Docker: [yes/no] no
- FlareSolverr User-Agent (see log traces or / endpoint):
- Are you using a proxy or VPN: [yes/no] no
- Are you using Captcha Solver: [yes/no] no
- If using captcha solver, which one: no
- URL to test this issue: https://torn.com

Description

Hey, While i did a get request to https://torn.com I am getting 500 internal error response with no cookies

Logged Error Messages

2023-01-10 09:45:05 DEBUG    ReqId 4432 Navigating to... http://www.torn.com
2023-01-10 09:45:05 INFO     ReqId 4432 Challenge detected. Selector found: #trk_jschal_js
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for title: Just a moment...
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for title: DDOS-GUARD
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: #cf-challenge-running
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: .ray_id
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: .attack-box
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: #cf-please-wait
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: #challenge-spinner
2023-01-10 09:45:05 DEBUG    ReqId 4432 Waiting for selector: #trk_jschal_js
2023-01-10 09:45:16 DEBUG    ReqId 4432 Timeout waiting for selector
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for title: Just a moment...
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for title: DDOS-GUARD
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: #cf-challenge-running
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: .ray_id
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: .attack-box
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: #cf-please-wait
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: #challenge-spinner
2023-01-10 09:45:16 DEBUG    ReqId 4432 Waiting for selector: #trk_jschal_js

Screenshots

No response

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Reactions: 5
  • Comments: 25 (3 by maintainers)

Most upvoted comments

The same here for the Docker version

2023-02-07 09:12:21 INFO Challenge detected. Title found: Just a moment...
2023-02-07 09:13:18 INFO Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://xxxxxx.org/', 'proxy': {'url': 'http://178.208.88.201:80'}}/
2023-02-07 09:13:19 ERROR Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-02-07 09:13:19 INFO Response in 61.384 s
2023-02-07 09:13:19 INFO 172.17.0.1 POST http://xx.xx.xx.xx:8191/v1 500 Internal Server Error

#715 solves the issue described in this thread. Seems like an easy merge / simple fix.

For those eager to test this fix, I have built and made available the fixed version:

docker run -d \
  --name=flaresolverr \
  -p 8191:8191 \
  -e LOG_LEVEL=info \
  --restart unless-stopped \
  rix1337/docker-flaresolverr:pull-request-715

+1. Issue started on Thursday. Running 3.0.2 in Docker on Unraid, image was working fine for the last month.

02/18/2023 10:05:01 AM
2023-02-18 15:05:01 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www.fanfiction.net/s/14043289/1/Raise', 'maxTimeout': 65000, 'cookies': [], 'postData': None}
02/18/2023 10:05:02 AM
2023-02-18 15:05:02 INFO     Challenge detected. Title found: Just a moment...
02/18/2023 10:05:06 AM
2023-02-18 15:05:06 ERROR    Error: Error solving the challenge. Timeout after 65.0 seconds.
02/18/2023 10:05:06 AM
2023-02-18 15:05:06 INFO     Response in 65.735 s
02/18/2023 10:05:06 AM
2023-02-18 15:05:06 INFO     172.17.0.1 POST http://xxx.xxx.x.xxx:xxxx/v1 500 Internal Server Error

Timestampsa re a bit weird b/c it’s requesting it multiple times, but the error is the same.

v3.0.4 seems to work. It’s being challenged each time, so I guess it’s not storing the session/cookies, but it is working (23 seconds a page though lol). I’ll put it through some more stress tests, but hopefully this resolves it for a long while.

Thanks for the effort!

Try v3.0.4

v3.0.3 should resolve the issue. Retry a few times if it continues after updating.

getting similar error when trying to use with 1337x.to, also tried with badasstorrents.com and got similar timeouts. flaresolverr logs for both below. This is on Unraid with container for flaresolverr/flaresolverr & lscr.io/linuxserver/prowlarr

Edit: Additional Info. Both containers are using a wg0 Wireguard network connection, with a specified dns of 9.9.9.9

2023-02-24 22:50:53 INFO     ReqId 22802995177216 Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://1337x.to/cat/Movies/time/desc/1/', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-02-24 22:50:53 WARNING  ReqId 22802995177216 Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-02-24 22:50:53 DEBUG    ReqId 22802995177216 Launching web browser...
2023-02-24 22:50:53 DEBUG    ReqId 22802995177216 Started executable: `/app/chromedriver` in a child process with pid: 857
2023-02-24 22:50:54 DEBUG    ReqId 22802781427456 Navigating to... https://1337x.to/cat/Movies/time/desc/1/
2023-02-24 22:50:55 INFO     ReqId 22802781427456 Challenge detected. Title found: Just a moment...
2023-02-24 22:50:55 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:06 DEBUG    ReqId 22802781427456 Timeout waiting for selector
2023-02-24 22:51:06 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:16 DEBUG    ReqId 22802781427456 Timeout waiting for selector
2023-02-24 22:51:16 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:26 DEBUG    ReqId 22802781427456 Timeout waiting for selector
2023-02-24 22:51:26 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:36 DEBUG    ReqId 22802781427456 Timeout waiting for selector
2023-02-24 22:51:36 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:46 DEBUG    ReqId 22802781427456 Timeout waiting for selector
2023-02-24 22:51:46 DEBUG    ReqId 22802781427456 Waiting for title: Just a moment...
2023-02-24 22:51:54 ERROR    ReqId 22802995177216 Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-02-24 22:51:54 DEBUG    ReqId 22802995177216 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1677297053348, 'endTimestamp': 1677297114387, 'version': '3.0.2'}
2023-02-24 22:51:54 INFO     ReqId 22802995177216 Response in 61.039 s
2023-02-24 22:51:54 INFO     ReqId 22802995177216 172.31.200.203 POST http://172.31.200.205:8191/v1 500 Internal Server Error

2023-02-24 22:59:43 INFO     ReqId 22802993075968 Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://badasstorrents.com/torrents/date/desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-02-24 22:59:43 WARNING  ReqId 22802993075968 Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-02-24 22:59:43 DEBUG    ReqId 22802993075968 Launching web browser...
2023-02-24 22:59:43 DEBUG    ReqId 22802993075968 Started executable: `/app/chromedriver` in a child process with pid: 1041
2023-02-24 22:59:43 DEBUG    ReqId 22802784577280 Navigating to... https://badasstorrents.com/torrents/date/desc
2023-02-24 22:59:46 INFO     ReqId 22802784577280 Challenge detected. Title found: Just a moment...
2023-02-24 22:59:46 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 22:59:56 DEBUG    ReqId 22802784577280 Timeout waiting for selector
2023-02-24 22:59:56 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 23:00:06 DEBUG    ReqId 22802784577280 Timeout waiting for selector
2023-02-24 23:00:06 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 23:00:16 DEBUG    ReqId 22802784577280 Timeout waiting for selector
2023-02-24 23:00:16 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 23:00:27 DEBUG    ReqId 22802784577280 Timeout waiting for selector
2023-02-24 23:00:27 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 23:00:37 DEBUG    ReqId 22802784577280 Timeout waiting for selector
2023-02-24 23:00:37 DEBUG    ReqId 22802784577280 Waiting for title: Just a moment...
2023-02-24 23:00:44 ERROR    ReqId 22802993075968 Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-02-24 23:00:44 DEBUG    ReqId 22802993075968 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1677297583241, 'endTimestamp': 1677297644157, 'version': '3.0.2'}
2023-02-24 23:00:44 INFO     ReqId 22802993075968 Response in 60.916 s
2023-02-24 23:00:44 INFO     ReqId 22802993075968 172.31.200.203 POST http://172.31.200.205:8191/v1 500 Internal Server Error

Same issue, in docker on Unraid.