yt-dlp: Chaturbate Extractor Returns a 403 error
DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE
- I understand that I will be blocked if I intentionally remove or skip any mandatory* field
Checklist
- I’m reporting that a supported site is broken
- I’ve verified that I’m running yt-dlp version 2023.03.04 (update instructions) or later (specify commit)
- I’ve checked that all provided URLs are playable in a browser with the same IP and same login details
- I’ve checked that all URLs and arguments with special characters are properly quoted or escaped
- I’ve searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
- I’ve read the guidelines for opening an issue
- I’ve read about sharing account credentials and I’m willing to share it if required
Region
United States
Provide a description that is worded well enough to be understood
When running yt-dlp with Chaturbate, the site now returns a 403 error. It was working a couple of weeks ago with the command shown below.
It seems as though Chaturbate updated something and the Extractor now needs updating too.
Happy to provide more information if needed.
$ yt-dlp -vU https://chaturbate.com/siswet19/
Provide verbose output that clearly demonstrates the problem
- Run your yt-dlp command with -vU flag added (
yt-dlp -vU <your command line>) - If using API, add
'verbose': TruetoYoutubeDLparams instead - Copy the WHOLE output (starting with
[debug] Command-line config) and insert it below
Complete Verbose Output
[debug] Command-line config: ['-vU', 'https://chaturbate.com/siswet19/']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2023.03.04 [392389b7d] (pip)
[debug] Python 3.10.6 (CPython x86_64 64bit) - Linux-5.15.0-58-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2, phantomjs 1.9.8
[debug] Optional libraries: Cryptodome-3.17, brotli-1.0.9, certifi-2022.12.07, mutagen-1.45.1, secretstorage-3.3.1, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1786 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.03.04, Current version: stable@2023.03.04
yt-dlp is up to date (stable@2023.03.04)
[Chaturbate] Extracting URL: https://chaturbate.com/siswet19/
[Chaturbate] siswet19: Downloading webpage
ERROR: [Chaturbate] siswet19: Unable to download webpage: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 694, in extract
ie_result = self._real_extract(url)
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/chaturbate.py", line 39, in _real_extract
webpage = self._download_webpage(
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 1097, in _download_webpage
return self.__download_webpage(url_or_request, video_id, note, errnote, None, fatal, *args, **kwargs)
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 1048, in download_content
res = getattr(self, download_handle.__name__)(url_or_request, video_id, **kwargs)
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 882, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 839, in _request_webpage
raise ExtractorError(errmsg, cause=err)
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 821, in _request_webpage
return self._downloader.urlopen(self._create_request(url_or_request, data, headers, query))
File "/home/computer/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 3742, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.10/urllib/request.py", line 525, in open
response = meth(req, response)
File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
response = self.parent.error(
File "/usr/lib/python3.10/urllib/request.py", line 563, in error
return self._call_chain(*args)
File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
result = func(*args)
File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Reactions: 1
- Comments: 19 (3 by maintainers)
Commits related to this issue
- [ie/chaturbate] Extract from API and support impersonation (#11555) Closes #6546, Closes #10359 Authored by: powergold1 — committed to wangshaojie1995/yt-dlp by powergold1 2 years ago
- [ie/chaturbate] Extract from API and support impersonation (#11555) Closes #6546, Closes #10359 Authored by: powergold1 — committed to vladisslav2011/yt-dlp by powergold1 2 years ago
- [ie/chaturbate] Extract from API and support impersonation (#11555) Closes #6546, Closes #10359 Authored by: powergold1 — committed to subrat-lima/yt-dlp by powergold1 2 years ago
BTW - using --force-ipv4 makes it work
Don’t worry about it
The fact that yt-dlp can’t solve Cloudflare captchas is a known issue, and one that will hopefully be solved by #7595
In the mean time, see https://github.com/yt-dlp/yt-dlp/wiki/FAQ#im-getting-http-error-403-and-the-site-has-an-open-issue-on-the-tracker-thats-labeled-cloudflare-related-what-can-i-do
On a side note, the curl command will most likely work if you use--user-agent "jhgfdcsfvgbhjnuikjytgfdcfvgbhju"(replace that string with whatever you want, except real user agents). Can you please test if it does?Update: apparently that won’t work. Anyway, if you’re trying to curl a cloudflare-protected site, I recommend using https://github.com/lwthiker/curl-impersonate
@bashonly Thank you for providing feedback.
I operate behind a VPN and tried multiple VPN locations with no success before submitting this ticket. I have further tested more VPN locations and found one that is working. So it has something to do with Chaturbate blocking the IP address of the specific VPN servers. Therefore yt-dlp has no issues here.
It is worth noting, in both cases, the browser had no problems and the video was playable.