Maximum size for Wildcards?

[lerestesunira]

Hi, Do you know if there is a maximum size for wildcards? I got an error when i add a 40mb wildcards in my wildcards folder, and swarm do not show the wildcards list anymore, the problem is resolved when i remove this wildcard.. So i was wondering what is the maximum size for wildcards? Thanks

[mcmonkey4eva]

There's no intentional size limit, there might be mishandling on particularly large files - I can't imagine how the hell you get 40 megabytes worth of plaintext word lists though.

I downloaded several wildcard packs, 400 total files worth, and they add up to just 3 megabytes.

So:

• (A) how the hell did you reach 40 megabytes? Can you post what you actually have there?
• (B) post the server->logs->pastebin button generated link including whatever error you get

My initial suspicion is that you put something in the wildcards folder that's thoroughly not an actual wildcard, some random unrelated file, and it's breaking trying to open it.

[lerestesunira]

Well magically when i add it back to the wildcards folder, it works now.. So i try to put a bigger one 156mb... (1 million random prompt), seems i cannot upload it here.

And i got the error again, it's a .txt, i verify the text, it's ok, do not seems to be an unrelated file, thanks.

[lerestesunira]

This error too if i try to change the view of the wildcards.. (going from list to card for example)

[mcmonkey4eva]

I see in your screenshot you used the log pastebin button, but then posted a screenshot instead of the link :( https://paste.denizenscript.com/View/132942

[mcmonkey4eva]

A million prompts in one file is -wild-. Even just in the screenshot I can see that it's a pretty bad webscrape, those first few prompts mostly look terrible, idk why you'd want that.

The way wildcards work, it sends a full copy of the data from the backend to the frontend (ie your web browser). With a quarter gigabyte of wildcard data, it looks like processing the web traffic needed for that overloads the system.

There might need to be a reworking of the wildcard system to compensate for massive scale files. Post on the issues tab as a feature request to support hyperscaled wildcards, and include a link to where such a file can even be downloaded from.

[lerestesunira]

Sorry but i'm relatively new to all of this, nevermind, i will split this maybe in small part. Throught I don't really want this, i'm just trying things and learn...
Even, just opening the file is long... I've downloaded this on Civitai. Thanks for your time, forget this!