Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wdrmaus.de supported only for some videos #32580

Open
5 tasks done
ChristianKuehnel opened this issue Oct 4, 2023 · 5 comments
Open
5 tasks done

wdrmaus.de supported only for some videos #32580

ChristianKuehnel opened this issue Oct 4, 2023 · 5 comments
Labels
broken-IE problem with existing site extraction duplicate

Comments

@ChristianKuehnel
Copy link

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2021.12.17
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

realated issues: #30484 #30556

Verbose log

> youtube-dl -v https://www.wdrmaus.de/filme/sachgeschichten/dampflok.php5

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.wdrmaus.de/filme/sachgeschichten/dampflok.php5']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.2 (CPython) - Linux-5.10.0-23-amd64-x86_64-with-glibc2.31
[debug] exe versions: ffmpeg 4.3.6-0, ffprobe 4.3.6-0
[debug] Proxy map: {}
[WDRPage] None: Downloading webpage
[download] Downloading playlist: None
[WDRPage] playlist None: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
ERROR: no suitable InfoExtractor for URL https://kinder.wdr.de/tv/die-sendung-mit-der-maus/av/video-dampflok-102.assetjsonp
  File "/home/user/bin/youtube-dl", line 8, in <module>
    sys.exit(main())
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/__init__.py", line 475, in main
    _real_main(argv)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/__init__.py", line 465, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 2068, in download
    res = self.extract_info(
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 808, in extract_info
    return self.__extract_info(url, ie, download, extra_info, process)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 847, in __extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 933, in process_ie_result
    return self.__process_playlist(ie_result, download)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 1067, in __process_playlist
    entry_result = self.__process_iterable_entry(entry, download, extra)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 1076, in __process_iterable_entry
    return self.process_ie_result(
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 885, in process_ie_result
    return self.extract_info(ie_result['url'],
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 810, in extract_info
    self.report_error('no suitable InfoExtractor for URL %s' % url)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 628, in report_error
    self.trouble(error_message, tb)
  File "/home/user/bin/youtube-dl-venv/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 590, in trouble
    tb_data = traceback.format_list(traceback.extract_stack())

Description

I've successfully downloaded a couple of videos from wdrmaus.de but others don't seem to work. It looks like they are using different video players for different (older?) content.

This video works:
https://www.wdrmaus.de/filme/sachgeschichten/ice4_teil1.php5

Examples of videos that don't work:

Looking at apage that doesn't work, it points to an assetjsonp file. Thhis assetjsonp contains the actual videoURL that you can directly download with wget.

@dirkf
Copy link
Contributor

dirkf commented Oct 4, 2023

Try the nightly build that includes PR #30556. Actually, use the nightly build anyway. See #30839. Probable duplicate of #30484.

@dirkf dirkf added broken-IE problem with existing site extraction duplicate labels Oct 4, 2023
@ChristianKuehnel
Copy link
Author

I did not find any information related to a "nightly build", however it works using the current master branch 00ef748 --> closing the issue. Thx for the fast reply!

I wasn't aware that there weren't any releases for such a long time...

@dirkf
Copy link
Contributor

dirkf commented Oct 4, 2023

#30839:

Known issues, fixed in git master code, or update/install from the nightly release repo:

@ChristianKuehnel
Copy link
Author

OK, so I've hit another video from the same site that doesn't work with the nightly release:

> youtube-dl -v https://www.wdrmaus.de/filme/sachgeschichten/radiergummi.php5
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.wdrmaus.de/filme/sachgeschichten/radiergummi.php5']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2023.12.07 [be008e657]
[debug] ** This version was built from the latest master code at https://github.com/ytdl-org/youtube-dl.
[debug] ** For support, visit the main site.
[debug] Python 3.9.2 (CPython x86_64 64bit) - Linux-5.10.0-23-amd64-x86_64-with-glibc2.31 - OpenSSL 1.1.1w  11 Sep 2023 - glibc 2.31
[debug] exe versions: ffmpeg 4.3.6-0, ffprobe 4.3.6-0
[debug] Proxy map: {}
[debug] Using fake IP 53.175.32.89 (DE) as X-Forwarded-For.
[WDRPage] radiergummi: Downloading webpage
[download] Downloading playlist: radiergummi
[WDRPage] playlist radiergummi: Collected 0 video ids (downloading 0 of them)
[download] Finished downloading playlist: radiergummi

@dirkf
Copy link
Contributor

dirkf commented Jan 6, 2024

The page is using attribute name data-extension-ard where the -ard was not seen before:

--- old/youtube_dl/extractor/wdr.py
+++ new/youtube_dl/extractor/wdr.py
@@ -263,7 +263,7 @@ class WDRPageIE(WDRIE):
                     (?:
                         (["\'])(?:mediaLink|wdrrPlayerPlayBtn|videoButton)\b.*?\1[^>]+|
                         (["\'])videoLink\b.*?\2[\s]*>\n[^\n]*
-                    )data-extension=(["\'])(?P<data>(?:(?!\3).)+)\3
+                    )data-extension(?:-ard)?=(["\'])(?P<data>(?:(?!\3).)+)\3
                     ''', webpage):
             media_link_obj = self._parse_json(
                 mobj.group('data'), display_id, transform_source=js_to_json,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
broken-IE problem with existing site extraction duplicate
Projects
None yet
Development

No branches or pull requests

2 participants