[Feat]: Z-Image non-Turbo: workflow and preset

[knoic]

Describe your use-case.

During training with comfyui/z-image base bf16, the images become corrupted and show snowflake-like patterns when sampling.

What would you like to see as a solution?

Normal Training and sampling

Have you considered alternatives? List them here.

Normal Training and sampling

[Garland677]

same here, need zimage base support

[hameerabbasi]

How many steps did you use? Z-Image base requires around 50 steps.

[Garland677]

How many steps did you use? Z-Image base requires around 50 steps.

yes, 50 steps generates exactly same as 16 steps, currupted.

[Calamdor]

int8 is not working, use bf16 or float8

[knoic]

int8 无法正常工作，请使用 bf16 或 float8。

Thanks, bf16 is running smoothly.

[niceguy4]

It seems like the finetune option works for training the base model with some adjustments (@Calamdor 's suggestion). I think an issue is with ComfyUI running the finetuned models. I have issues, too. All black images on the trained model but no issues with the base model in ComfyUI.

I can also generate images (inference) using the finetuned model using musubi-tuner.

Possibly a ComfyUI issue or my dependencies are borked.

edit: this was confirmed by the Comfyui team as of yesterday. Comfyui is unable to generate images using finetuned models from the base model.

[dxqb]

edit: this was confirmed by the Comfyui team as of yesterday. Comfyui is unable to generate images using finetuned models from the base model.

full-finetunes? or including LoRA?
please link the issue

[dxqb]

Currently known settings; will add a preset when things are more clear

• use the Z-Image Turbo preset
• change base model
• remove the transformer override (De-Turbo)
• change quantization settings; details here: https://github.com/Nerogar/OneTrainer/wiki/Quantization#artifacts
• you might want to experiment with timestep shifting, because Z-Image non-Turbo uses a higher shift during inference than Z-Image Turbo
• some people have commented that Z-Image non-Turbo requires a higher learning rate; but this might also be related to timestep shifting.

[niceguy4]

edit: this was confirmed by the Comfyui team as of yesterday. Comfyui is unable to generate images using finetuned models from the base model.

full-finetunes? or including LoRA? please link the issue

Yes, full finetunes on the Z-Image "base" model. I posted an image of ComfyUI's response. I can tag you in discord.

[kentrob-byte]

My character lora results improved significantly switching from adamw .0003 (the setting I'd been using with ZiT) to prodigy 1. I wasn't getting much likeness when using the lora with ZiT even if I trained out to 200 epochs, but now I'm getting a good likeness at 150.

Edit: Using adam_adv with a higher LR (0.001) was also viable, as I continue to experiment.

[qnxsgwy]

Please add the training preset for Z-Image non-Turbo as soon as possible. Thank you very much, I’m already eager to test it