yt-dlp: [Crunchyroll] Does not gives all available subtitles

Checklist

  • I’m reporting a broken site
  • I’ve verified that I’m running yt-dlp version 2022.07.18 (update instructions) or later (specify commit)
  • I’ve checked that all provided URLs are playable in a browser with the same IP and same login details
  • I’ve checked that all URLs and arguments with special characters are properly quoted or escaped
  • I’ve searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
  • I’ve read the guidelines for opening an issue
  • I’ve read about sharing account credentials and I’m willing to share it if required

Region

Brazil

Provide a description that is worded well enough to be understood

Crunchyroll now forces to use the beta website, but yt-dlp can’t find any subtitles other than en-us.

By using https://beta.crunchyroll.com/watch/G8WUN8VKP/the-ruler-of-conspiracy as example.

yt-dlp first checks the URL <API>/cms/v2/BR/M3/crunchyroll/episodes/G8WUN8VKP

Then it fetches the stream data from playback URL in API response.

But looking at where the beta website gets the subtitles list and downloads.

Beta website, get the available streams from endpoint /cms/v2/BR/M3/crunchyroll/videos/GQ9FG10XZ/streams.

The above URL is avaiable at episodes endpoint, at path '__links__'->'streams'

The streams endpoint, has all the streams available for the video, and also, the subtitles, check print:

Screenshot_20220726_160040


I hope that was helpful to implement the missing functionality.

Provide verbose output that clearly demonstrates the problem

  • Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
  • Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output

[debug] Command-line config: ['--cookies', '/home/jomp16/cookies.txt', '--list-subs', '--skip-download', '-vU', 'https://beta.crunchyroll.com/watch/G8WUN8VKP/the-ruler-of-conspiracy']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.07.18 [135f05e]
[debug] Python 3.10.5 (CPython 64bit) - Linux-5.18.14-lqx1-1-lqx-x86_64-with-glibc2.35 (glibc 2.35)
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] exe versions: ffmpeg 5.0.1 (setts), ffprobe 5.0.1, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.12.0, brotlicffi-1.0.9.2, certifi-2022.06.15, secretstorage-3.3.2, sqlite3-2.6.0
[debug] Proxy map: {}
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2022.07.18, Current version: 2022.07.18
yt-dlp is up to date (2022.07.18)
[debug] [crunchyroll:beta] Extracting URL: https://beta.crunchyroll.com/watch/G8WUN8VKP/the-ruler-of-conspiracy
[crunchyroll:beta] Retrieving main page
[crunchyroll:beta] Authenticating with cookie
[crunchyroll:beta] Retrieving signed policy
[crunchyroll:beta] the-ruler-of-conspiracy: Retrieving episode metadata
[crunchyroll:beta] the-ruler-of-conspiracy: Retrieving stream info
[crunchyroll:beta] the-ruler-of-conspiracy: Downloading adaptive_hls information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[info] Available subtitles for G8WUN8VKP:
Language Formats
en-US    ass

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 18 (9 by maintainers)

Commits related to this issue

Most upvoted comments

@ArturiaPendragon and now the same command lists all available subtitles.

Maybe Crunchyroll is releasing the incomplete playback stream and then later releasing the subtitles as an alternative stream, and then later merging them into one stream.

I think that YT-DLP should use the /cms/v2/[...]/videos/<ID>/streams listed above, that the player uses to list all the available subtitles and hardcoded videos instead of getting the single, playback stream URL that at times doesn’t have all the subtitles available.

Here again this night :

[debug] Command-line config: ['--cookies', 'cookies.txt', '-U', 'https://www.crunchyroll.com/fr/lucifer-and-the-biscuit-hammer/episode-4-asahina-hisame-and-shinonome-hangetsu-852956', '--user-agent', 'Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Firefox/91.0', '--write-sub', '--no-download', '--list-subs', '--skip-download', '-vU']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.07.18 [135f05e] (zip)
[debug] Python 3.9.2 (CPython 64bit) - Linux-4.19.0-18-amd64-x86_64-with-glibc2.31 (glibc 2.31)
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] exe versions: ffmpeg N-105731-gb14321e307 (fdk,setts), ffprobe N-105731-gb14321e307
[debug] Optional libraries: Crypto-3.14.1, certifi-2020.06.20, sqlite3-2.6.0
[debug] Proxy map: {}
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2022.07.18, Current version: 2022.07.18
yt-dlp is up to date (2022.07.18)
[debug] [crunchyroll] Extracting URL: https://www.crunchyroll.com/fr/lucifer-and-the-biscuit-hammer/episode-4-asahina-hisame-and-shinonome-hangetsu-852956
[crunchyroll] 852956: Downloading webpage
[crunchyroll] 852956: Redirected to beta site - https://beta.crunchyroll.com/watch/GN7UD9J3Q/asahina-hisame-and-shinonome-hangetsu
[debug] [crunchyroll:beta] Extracting URL: https://beta.crunchyroll.com/watch/GN7UD9J3Q/asahina-hisame-and-shinonome-hangetsu
[crunchyroll:beta] Retrieving main page
[crunchyroll:beta] Authenticating with cookie
[crunchyroll:beta] Retrieving signed policy
[crunchyroll:beta] asahina-hisame-and-shinonome-hangetsu: Retrieving episode metadata
[crunchyroll:beta] asahina-hisame-and-shinonome-hangetsu: Retrieving stream info
[crunchyroll:beta] asahina-hisame-and-shinonome-hangetsu: Downloading adaptive_hls information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[debug] Downloading subtitles: en-US
[info] Available subtitles for GN7UD9J3Q:
Language Formats
en-US    ass

but on the website : https://i.imgur.com/R1VlWfA.png