youtube-dl: Unable to extract post url, --ap-mso=Comcast_SSO does not work
Please follow the guide below
- You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
- Put an
x
into all the boxes [ ] relevant to your issue (like that [x]) - Use Preview tab to see how your issue will actually look like
Make sure you are using the latest version: run youtube-dl --version
and ensure your version is 2016.11.18. If it’s not read this FAQ entry and update. Issues with outdated version will be rejected.
- I’ve verified and I assure that I’m running youtube-dl 2016.11.18
Before submitting an issue make sure you have:
- At least skimmed through README and most notably FAQ and BUGS sections
- Searched the bugtracker for similar issues including closed ones
What is the purpose of your issue?
- Bug report (encountered problems with youtube-dl)
- Site support request (request for adding support for a new site)
- Feature request (request for a new functionality)
- Question
- Other
Tried to use Comcast_SSO with fox and amc
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'--ap-mso=Comcast_SSO', u'--ap-username=PRIVATE', u'--ap-password=PRIVATE', u'--verbose', u'http://www.fox.com/watch/813014083891/7684601088']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.11.18
[debug] Python version 2.7.12 - Darwin-16.1.0-x86_64-i386-64bit
[debug] exe versions: avconv 11.4, avprobe 11.4, ffmpeg 3.2, ffprobe 3.2
[debug] Proxy map: {}
[FOX] 813014083891: Downloading webpage
[FOX] 813014083891: Downloading Provider Redirect Page
ERROR: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 694, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 357, in extract
return self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/fox.py", line 48, in _real_extract
query['auth'] = self._extract_mvpd_auth(url, video_id, 'fbc-fox', resource)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1399, in _extract_mvpd_auth
provider_redirect_page_res, 'Downloading Provider Login Page')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1322, in post_form
post_url = self._html_search_regex(r'<form[^>]+action=(["\'])(?P<url>.+?)\1', form_page, 'post url', group='url')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 669, in _html_search_regex
res = self._search_regex(pattern, string, name, default, fatal, flags, group)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 660, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'--ap-mso=Comcast_SSO', u'--ap-username=PRIVATE', u'--ap-password=PRIVATE', u'--verbose', u'http://www.amc.com/shows/the-walking-dead/full-episodes/season-07/episode-05/go-getters']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.11.18
[debug] Python version 2.7.12 - Darwin-16.1.0-x86_64-i386-64bit
[debug] exe versions: avconv 11.4, avprobe 11.4, ffmpeg 3.2, ffprobe 3.2
[debug] Proxy map: {}
[AMCNetworks] go-getters: Downloading webpage
[AMCNetworks] go-getters: Downloading JSON metadata
[AMCNetworks] HJLoSZIQJoKa: Downloading Provider Redirect Page
ERROR: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 694, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 357, in extract
return self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/amcnetworks.py", line 64, in _real_extract
query['auth'] = self._extract_mvpd_auth(url, video_id, requestor_id, resource)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1399, in _extract_mvpd_auth
provider_redirect_page_res, 'Downloading Provider Login Page')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1322, in post_form
post_url = self._html_search_regex(r'<form[^>]+action=(["\'])(?P<url>.+?)\1', form_page, 'post url', group='url')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 669, in _html_search_regex
res = self._search_regex(pattern, string, name, default, fatal, flags, group)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 660, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
About this issue
- Original URL
- State: closed
- Created 8 years ago
- Comments: 41 (2 by maintainers)
Commits related to this issue
- Comcast_SSO another way how Comcast can autologin users Fixes #11257 — committed to outcoldman/youtube-dl by outcoldman 8 years ago
- Comcast_SSO another way how Comcast can autologin users Fixes #11257 — committed to outcoldman/youtube-dl by outcoldman 8 years ago
Can we get an update on this issue? DirecTV is broken with this same issue also. Thanks!
I’m also having the issue:
Traceback (most recent call last): File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info ie_result = ie.extract(url) File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 529, in extract ie_result = self._real_extract(url) File "/usr/local/bin/youtube-dl/youtube_dl/extractor/go.py", line 137, in _real_extract url, video_id, requestor_id, resource) File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1448, in _extract_mvpd_auth self._DOWNLOADING_LOGIN_PAGE) File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adobepass.py", line 1360, in post_form post_url = self._html_search_regex(r'<form[^>]+action=(["\'])(?P<url>.+?)\1', form_page, 'post url', group='url') File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1013, in _html_search_regex res = self._search_regex(pattern, string, name, default, fatal, flags, group) File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1004, in _search_regex raise RegexNotFoundError('Unable to extract %s' % _name)
the above fix works for youtube-dl from source, but is there a way to patch the pre-compiled version?
For those running from source code or compiling your own, the quick fix for Comcast Xfinity is to use this version of adobepass.py:
https://raw.githubusercontent.com/bhamboss/youtube-dl/patch-1/youtube_dl/extractor/adobepass.py
That is from https://github.com/bhamboss/youtube-dl/blob/patch-1/youtube_dl/extractor/adobepass.py and I can confirm this works with Xfinity’s new login if you are coming in from an Xfinity IP address.
Just to be clear, Xfinity authenticates differently if you are coming in from one of their IP addresses vs. if you are coming in from the IP of some other provider. I tested the above patch coming from an Xfinity IP. I did NOT test it from another provider’s IP.
If I run diff -u on the original and patched files I get this:
Note the use of “oauth.xfinity.com” rather than “login.comcast.net” which is what apparently worked back in 2016, but not in 2019.
Still running into the original (“Unable to extract post url”) issue. For me it’s with anything that’s locked to your provider on http://disneynow.go.com. I just tried NBC and Simpsons World and they both work fine. Here’s the output of my --version, just so you can see I’m on the most recent one:
And here’s my verbose output when I try to download.
Charter/Spectrum here, also trying to download My 600-lb life, provider sign-in and play works fine in browser, with youtube-dl (latest version at time of this post) using --ap-mso=Charter_Direct or --cookies, get same error as halolordkiller3 ; “ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.”
Tried after logging in successfully in browser, still same error.
I remembered that for discovery you should use the “go” urls, I didn’t realize “go” had been discontinued. So that sucks.
I did try running youtube-dl WITH the browser page opened AFTER successfully signing in, using both --ap-mso and --cookies, had no effect on issue.
–ap-mso:
–ap-cookies
pagedumps.zip
worked for me, you missed a - in --ap-password
The regex in adobepass.py now needs to be:
r'continue:\s*"(https://oauth.xfinity.com/oauth/authorize\?.+)"',
instead ofr'continue:\s*"(https://login.comcast.net/oauth/authorize\?.+)"',