Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[newgrounds] videos not being downloaded #1042

Closed
kattjevfel opened this issue Sep 29, 2020 · 3 comments
Closed

[newgrounds] videos not being downloaded #1042

kattjevfel opened this issue Sep 29, 2020 · 3 comments

Comments

@kattjevfel
Copy link
Contributor

Noticed I got a bunch of "Unable to get download URL for ..." today, all the ones I had trouble with are mp4s.
Example URL: https://www.newgrounds.com/portal/view/733388

gallery-dl --ignore-config --verbose --option 'extractor.newgrounds.include="all"' https://www.newgrounds.com/portal/view/733388
[gallery-dl][debug] Version 1.15.1-dev
[gallery-dl][debug] Python 3.8.5 - Linux-5.8.12-20-tkg-upds-x86_64-with-glibc2.2.5
[gallery-dl][debug] requests 2.24.0 - urllib3 1.25.10
[gallery-dl][debug] Starting DownloadJob for 'https://www.newgrounds.com/portal/view/733388'
[newgrounds][debug] Using NewgroundsMediaExtractor for 'https://www.newgrounds.com/portal/view/733388'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.newgrounds.com:443
[urllib3.connectionpool][debug] https://www.newgrounds.com:443 "GET /portal/view/733388 HTTP/1.1" 200 9788
[newgrounds][warning] Unable to get download URL for 'https://www.newgrounds.com/portal/view/733388'
@mikf mikf closed this as completed in 5b927c1 Oct 1, 2020
@TestPolygon
Copy link

TestPolygon commented Oct 7, 2020

Wait. It looks like you download only 720p version now. You should remove .720p (for example) from the URL to get the URL leads to the original (?) file.

The first from JSON:
https://uploads.ungrounded.net/alternate/564000/564957_alternate_31.720p.mp4?1359712249 10.2 MB
The changed:
https://uploads.ungrounded.net/alternate/564000/564957_alternate_31.mp4?1359712249 24.5 MB


{
    "id": 595355,
    "title": "Alien Hominid Fan Trailer",
    "author": "kickinthehead",
    "sources": {
        "720p": [
            {
                "type": "video\/mp4",
                "src": "https:\/\/uploads.ungrounded.net\/alternate\/564000\/564957_alternate_31.720p.mp4?1359712249"
            }
        ],
        "360p": [
            {
                "type": "video\/mp4",
                "src": "https:\/\/uploads.ungrounded.net\/alternate\/564000\/564957_alternate_31.360p.mp4?1359712249"
            }
        ]
    }
}

@mikf
Copy link
Owner

mikf commented Oct 8, 2020

@TestPolygon f9c1684

@God-damnit-all
Copy link
Contributor

God-damnit-all commented Oct 15, 2020

@mikf It seems that while this usually works, it doesn't always. Sometimes the 'original video URL' that gallery-dl retrieves 404s, but the 720p variant works properly. This might need a fallback URL system like the twitter scraper has.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants