Ignore Errors

[blezinski]

Can we get a command similar to youtube-dl's --ignore-errors? I can't find it in any of the documentation and it would be helpful when downloading a large list of URLs
thanks

[mikf]

gallery-dl does that by default. When encountering errors while downloading from a list of URLs, those errors will be reported and the next URL processed. (or am I missing something here?)

[kattjevfel]

Add 2> /dev/null to the end of your command lol, no more errors!

[blezinski]

When encountering errors while downloading from a list of URLs, those errors will be reported and the next URL processed.

I confused a URL with a single file, what i mean is skipping single file errors and continue scraping within that link instead of encountering a file error and skipping directly to the next URL.
If for instance the very first file has a problem it will create an empty folder and move on even though it's just that one file with the issue.

[pxssy]

On this point, is there a way to print errors? like >output.txt doesn't print errors, only successes. I'd like to go back and specifically target those errors manually.

[Hrxn]

Print errors? What do you mean? There is already a log file function.

[kattjevfel]

On this point, is there a way to print errors? like >output.txt doesn't print errors, only successes. I'd like to go back and specifically target those errors manually.

That's what 2> is for, it will print only errors into a file.
If you want to redirect everything into a file, you can use &>.

[mikf]

@blezinski That sounds like an error during the data extraction process, not the download itself, and those can only be ignored by modifying the relevant extractor code, i.e. no general/global option possible. What site(s) are you talking about?

@pxssy In addition to redirecting stderr with 2>, you can also use --write-log or the corresponding config option: output.logfile.

[blezinski]

Trying to download from E621. Here's my filename format
"filename": "{id}_{artist}_{filename}.{extension}"
If there's a lot of artists then i hit the windows filename limit and it fails to download

[mikf]

You can restrict the length of individual replacement fields and avoid a "filename too long" error that way: "filename": "{id}_{artist[0:200]}_{filename}.{extension}"