youtube-dl: [YouTube] Unable to extract video data

Checklist

  • I’m reporting a broken site support
  • I’ve verified that I’m running youtube-dl version 2019.09.28
  • I’ve checked that all provided URLs are alive and playable in a browser
  • I’ve checked that all URLs and arguments with special characters are properly quoted or escaped
  • I’ve searched the bugtracker for similar issues including closed ones

Verbose log

 youtube-dl -v --call-home --dump-single-json https://youtu.be/4V3sN0z6kls
[debug] System config: []
[debug] User config: ['--retries', '10', '--format', 'best', '--max-filesize', '1G', '--no-warnings', '--abort-on-error', '--no-overwrites', '--no-playlist', '--no-mtime', '--no-cache-dir', '--console-title', '--no-post-overwrites', '--embed-thumbnail', '--add-metadata', '--output', '~/public/%(id)s.%(ext)s']
[debug] Custom config: []
[debug] Command-line args: ['-v', '--call-home', '--dump-single-json', 'https://youtu.be/4V3sN0z6kls']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.09.28
[debug] Python version 3.5.2 (CPython) - Linux-4.4.0-22-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.15, ffprobe 2.8.15
[debug] Proxy map: {}
[debug] Public IP address: xxxxxxxxxxxxxxxxxxxx
ERROR: 4V3sN0z6kls: YouTube said: Unable to extract video data
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/lib/python3.5/dist-packages/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/lib/python3.5/dist-packages/youtube_dl/extractor/youtube.py", line 1836, in _real_extract
    'YouTube said: %s' % unavailable_message, expected=True, video_id=video_id)
youtube_dl.utils.ExtractorError: 4V3sN0z6kls: YouTube said: Unable to extract video data

Description

The error is “ERROR: Unable to extract video data” and and i cannot reproduce it from multiple countries.

Not working for several URLs/IDs like: ERROR: pUZoDgj9iHw: YouTube said: Unable to extract video data ERROR: pUZoDgj9iHw: YouTube said: Unable to extract video data ERROR: JVmty59D3Co: YouTube said: Unable to extract video data ERROR: SoCs8HGurSY: YouTube said: Unable to extract video data ERROR: -LhtcnrZSMs: YouTube said: Unable to extract video data ERROR: fuBG_osuqy8: YouTube said: Unable to extract video data ERROR: 6wB7k9SopIA: YouTube said: Unable to extract video data ERROR: 6wB7k9SopIA: YouTube said: Unable to extract video data ERROR: wKyTjWtx4qc: YouTube said: Unable to extract video data ERROR: t6kpZOYecAc: YouTube said: Unable to extract video data ERROR: uDD5u43EvE4: YouTube said: Unable to extract video data

Could you please help?

Many Thanks

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Reactions: 3
  • Comments: 38

Most upvoted comments

I was able to bypass this for at least one video by passing --user-agent "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)".

@dstftw Can this be re-opened? Obviously something going on here.

Maybe it’s time to put some download speed restrictions into youtube-dl? Edit: I’m using trickle for that: https://github.com/mariusae/trickle There’s at least a Debian package. In Windows I used to use Network Limiter. Not sure that’s still a thing.

I am also having this issue

Ubuntu 18.04:

youtube-dl -f 18 -v "https://www.youtube.com/user/ashens/videos"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-f', u'18', u'-v', u'https://www.youtube.com/user/ashens/videos']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.09.28
[debug] Python version 2.7.15+ (CPython) - Linux-4.15.0-65-generic-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg 3.4.6, ffprobe 3.4.6
[debug] Proxy map: {}
[youtube:user] ashens: Downloading channel page
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading webpage
[download] Downloading playlist: Uploads from ashens
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #1
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #2
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #3
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #4
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #5
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #6
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #7
[youtube:playlist] playlist Uploads from ashens: Downloading 792 videos
[download] Downloading video 1 of 792
[youtube] gdCNE5L5yPw: Downloading webpage
[youtube] gdCNE5L5yPw: Downloading video info webpage
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
ERROR: gdCNE5L5yPw: YouTube said: Unable to extract video data
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/youtube.py", line 1836, in _real_extract
    'YouTube said: %s' % unavailable_message, expected=True, video_id=video_id)
ExtractorError: gdCNE5L5yPw: YouTube said: Unable to extract video data

Ubuntu 19.10:

youtube-dl -f 18 -v "https://www.youtube.com/user/ashens/videos"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-f', u'18', u'-v', u'https://www.youtube.com/user/ashens/videos']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.09.28
[debug] Python version 2.7.16+ (CPython) - Linux-5.3.0-13-generic-x86_64-with-Ubuntu-19.10-eoan
[debug] exe versions: ffmpeg 4.1.4-1build2, ffprobe 4.1.4-1build2, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube:user] ashens: Downloading channel page
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading webpage
[download] Downloading playlist: Uploads from ashens
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #1
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #2
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #3
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #4
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #5
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #6
[youtube:playlist] UUxt9Pvye-9x_AIcb1UtmF1Q: Downloading page #7
[youtube:playlist] playlist Uploads from ashens: Downloading 792 videos
[download] Downloading video 1 of 792
[youtube] gdCNE5L5yPw: Downloading webpage
[youtube] gdCNE5L5yPw: Downloading video info webpage
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests
[debug] Invoking downloader on u'https://r3---sn-hp57knz6.googlevideo.com/videoplayback?expire=1570709485&ei=jcueXYmTLtLLkATm8aDICA&ip=73.42.87.4&id=o-AIiHhS7-kK8UWErf8QHow_jUnKHcqMaY6ObM2Gv5AmZH&itag=18&source=youtube&requiressl=yes&mm=31%2C26&mn=sn-hp57knz6%2Csn-5uaeznr6&ms=au%2Conr&mv=m&mvi=2&pl=19&initcwndbps=2247500&mime=video%2Fmp4&gir=yes&clen=100486538&ratebypass=yes&dur=1422.663&lmt=1570682934001005&mt=1570687783&fvip=3&fexp=23842630&c=WEB&txp=5531432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cmime%2Cgir%2Cclen%2Cratebypass%2Cdur%2Clmt&sig=ALgxI2wwRAIgbLGNphkpB_GxJ_xj-fHjXpuYVWrmV_VJzUNSlwdW3bMCIBDpDx9CurtTGE7K0ab_GUXjTtLEb8z5yvMs4iGiVTqo&lsparams=mm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AHylml4wRQIhAJesTZIu6xVM3bJ8FU09xFNYeATg-QWm5-5UMF2N6180AiBOsRwN2vcE0oAhiMXHsC9j5Qywlvr_SEVLfSRKSRpL_w%3D%3D'
[download] Resuming download at byte 12581888
[download] Destination: Sega Mega Drive Mini _ Ashens-gdCNE5L5yPw.mp4
[download]  37.6% of 95.83MiB at 20.61MiB/s ETA 00:02^C
ERROR: Interrupted by user

Hey, why changing the user agent doesn’t work?

user@Deskt0p:~/Desktop/USL$ youtube-dl --user-agent “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.117 Safari/537.36” https://www.youtube.com/channel/UCcdUt-ezblFANUS3PfNZiTQ/videos [youtube:channel] UCcdUt-ezblFANUS3PfNZiTQ: Downloading channel page [youtube:playlist] UUcdUt-ezblFANUS3PfNZiTQ: Downloading webpage [download] Downloading playlist: Uploads from Un Señor de Logroño [youtube:playlist] playlist Uploads from Un Señor de Logroño: Downloading 94 videos [download] Downloading video 1 of 94 [youtube] B4FUktVJ4Aw: Downloading webpage [youtube] B4FUktVJ4Aw: Downloading video info webpage WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests ERROR: B4FUktVJ4Aw: YouTube said: Unable to extract video data

I feel like it’s likely because YouTube is using some kind of machine learning or some other factor to determine what computer you are using. Like I mentioned before when we thought it was a kernel thing because it worked on a different computer in my house that happened to have a different Ubuntu version but not the primary one I use YTDL on.

Waiting like a week seemed to solve it. So I think they are using something fancy and unknown to us to identity users who use YTDL a lot. My issue I think was that I downloaded the last 5 videos from over 100 channels in a multithreaded fashion (16 channels at a time…) every hour… they did not like this bandwidth consumption I think. So now I just do it once a day and have not seen the problem since. Or use a VPN.

EDIT: Also I run the job manually now. Doing that on a strict schedule using cron also seemed to tip them off. Even once a day.

Hey, why changing the user agent doesn’t work?

user@Deskt0p:~/Desktop/USL$ youtube-dl --user-agent “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.117 Safari/537.36” https://www.youtube.com/channel/UCcdUt-ezblFANUS3PfNZiTQ/videos [youtube:channel] UCcdUt-ezblFANUS3PfNZiTQ: Downloading channel page [youtube:playlist] UUcdUt-ezblFANUS3PfNZiTQ: Downloading webpage [download] Downloading playlist: Uploads from Un Señor de Logroño [youtube:playlist] playlist Uploads from Un Señor de Logroño: Downloading 94 videos [download] Downloading video 1 of 94 [youtube] B4FUktVJ4Aw: Downloading webpage [youtube] B4FUktVJ4Aw: Downloading video info webpage WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests WARNING: unable to download video info webpage: HTTP Error 429: Too Many Requests ERROR: B4FUktVJ4Aw: YouTube said: Unable to extract video data

Why are we talking about kernels? I assume it have zero relation with system kernels and think the issue is related with something like useragent.

Same issue here, can’t get anything anymore after just 2 days of using youtube dl. If anyone knows a fix for this that would be amazing!

I’m having to change my proxies every couple of days because Youtube seems to be detecting this faster and faster now and as a result YouTube-DL is running into the same issue (and utilizing a proxy seems to be the only way to work around this)