Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

You will only be able to load 100 entries max. #1

Open
e-d-n-a opened this issue Dec 2, 2020 · 5 comments
Open

You will only be able to load 100 entries max. #1

e-d-n-a opened this issue Dec 2, 2020 · 5 comments

Comments

@e-d-n-a
Copy link

e-d-n-a commented Dec 2, 2020

In the function scrape_watch_later_playlist you only extract the links from the initial page request, but playlists containing >100 entries need further requests (continuations) to load more entries in 100-entry packets via 1 of the 2 JSON-APIs.

I'm not sure, if you're aware of that, as this actually limits the use of this tool substantially.

You can see in the source code of "youtube-dl", how they deal with the continuations, although it's a bit convoluted there.

You could try to get the youtube-session-cookies from your Chromedriver-instance and use it with youtube-dl,
as it is perfectly capable of extracting complete youtube-playlists incl. the watchlater-playlist.
It only seems to have an issue with the Google-login atm, but still works when providing a netscape-cookie-file for the youtube-domain from a logged-in browser-session, where javascript execution has been halted.

@longpdo
Copy link
Owner

longpdo commented Dec 2, 2020

Ok, thanks for the information. I did not think of playlists with more than 100 entries.

@irate-overlord
Copy link

My Watch Later list has 2300 entries, which I believe is the max (I'm only guessing this because it will still let me click to add new videos, but they do not appear on the WL). Just to give you an idea of how big they can get.

@Aman-1412
Copy link

My Watch Later list has 2300 entries, which I believe is the max

3900 here.
I read somewhere that the limit is 5000.
I need to get my youtube life sorted out.. Getting rid of that procrastination seems to be a good start.

@SingeStheos
Copy link

is there no solution? i have 128 videos. this is terribly unlucky for me.

@marcozeller
Copy link

is there no solution? i have 128 videos. this is terribly unlucky for me.

In case you are still looking for a solution.
I played a bit with the script and had to make some adjustments for it to run.
Guess youtube has updated its page-layout and bot-detection.

I also found a simple workaround to the 100 videos limitation.
Please check it out here:
https://github.com/marcozeller/youtube-dl-watch-later-playlist/tree/fix-issues

Maybe it can be merged to this repository at some point.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants