Make loras work on nvfp4 models. by comfyanonymous · Pull Request #11837 · Comfy-Org/ComfyUI

comfyanonymous · 2026-01-13T03:25:05Z

The initial applying is a bit slow but will probably be sped up in the future.

xueqing0622 · 2026-01-13T11:58:26Z

yes, lora take effect. thx

FurkanGozukara · 2026-01-13T16:23:15Z

i just tested and it didnt work on FLUX 2

FLUX_Dev_Kontext_NVFP4.safetensors

2026-01-13 16:18:45.048 [Debug] [BackendHandler] backend #0 will load a model: /workspace/SwarmUI/Models/diffusion_models/FLUX_Dev_Kontext_NVFP4.safetensors, with 1 requests waiting for 140.8 seconds
2026-01-13 16:18:45.073 [Debug] [ComfyUI-0/STDERR] got prompt
2026-01-13 16:18:46.392 [Debug] [ComfyUI-0/STDERR] Using xformers attention in VAE
2026-01-13 16:18:46.393 [Debug] [ComfyUI-0/STDERR] Using xformers attention in VAE
2026-01-13 16:18:47.723 [Debug] [ComfyUI-0/STDERR] VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2026-01-13 16:19:10.311 [Debug] [ComfyUI-0/STDERR] CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2026-01-13 16:19:11.175 [Debug] [ComfyUI-0/STDERR] Found quantization metadata version 1
2026-01-13 16:19:11.175 [Debug] [ComfyUI-0/STDERR] Detected mixed precision quantization
2026-01-13 16:19:11.175 [Debug] [ComfyUI-0/STDERR] Using mixed precision operations
2026-01-13 16:19:11.192 [Debug] [ComfyUI-0/STDERR] model weight dtype torch.bfloat16, manual cast: torch.bfloat16
2026-01-13 16:19:11.193 [Debug] [ComfyUI-0/STDERR] model_type FLUX
2026-01-13 16:19:15.536 [Debug] [ComfyUI-0/STDERR] Prompt executed in 30.46 seconds
2026-01-13 16:19:15.963 [Debug] [BackendHandler] backend #0 loaded model, returning to pool
2026-01-13 16:19:16.109 [Debug] [BackendHandler] Backend request #17 found correct model on #0
2026-01-13 16:19:16.109 [Debug] [BackendHandler] Backend request #17 finished.
2026-01-13 16:19:16.111 [Debug] [ComfyUI-0/STDERR] got prompt
2026-01-13 16:19:18.750 [Debug] [ComfyUI-0/STDERR] Requested to load FluxClipModel_
2026-01-13 16:19:19.861 [Debug] [ComfyUI-0/STDERR] loaded completely; 94723.93 MB usable, 9319.23 MB loaded, full load: True
2026-01-13 16:19:20.123 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.double_stream_modulation_img.lin.lora_A.weight
2026-01-13 16:19:20.123 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.double_stream_modulation_img.lin.lora_B.weight
2026-01-13 16:19:20.123 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.double_stream_modulation_txt.lin.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.double_stream_modulation_txt.lin.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.38.linear1.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.38.linear1.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.38.linear2.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.38.linear2.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.39.linear1.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.39.linear1.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.39.linear2.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.39.linear2.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.40.linear1.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.40.linear1.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.40.linear2.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.40.linear2.lora_B.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.41.linear1.lora_A.weight
2026-01-13 16:19:20.124 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.41.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.41.linear2.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.41.linear2.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.42.linear1.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.42.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.42.linear2.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.42.linear2.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.43.linear1.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.43.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.43.linear2.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.43.linear2.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.44.linear1.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.44.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.44.linear2.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.44.linear2.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.45.linear1.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.45.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.45.linear2.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.45.linear2.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.46.linear1.lora_A.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.46.linear1.lora_B.weight
2026-01-13 16:19:20.125 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.46.linear2.lora_A.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.46.linear2.lora_B.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.47.linear1.lora_A.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.47.linear1.lora_B.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.47.linear2.lora_A.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_blocks.47.linear2.lora_B.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_stream_modulation.lin.lora_A.weight
2026-01-13 16:19:20.126 [Debug] [ComfyUI-0/STDERR] lora key not loaded: diffusion_model.single_stream_modulation.lin.lora_B.weight
2026-01-13 16:19:20.138 [Debug] [ComfyUI-0/STDERR] Requested to load Flux
2026-01-13 16:19:20.540 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.9.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.609 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.8.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.682 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.7.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.780 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.6.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.829 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.5.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.876 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.4.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.929 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.37.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:20.993 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.36.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.083 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.35.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.130 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.34.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.179 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.33.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.225 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.32.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.275 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.31.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.346 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.30.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.403 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.3.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.451 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.29.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.530 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.28.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.603 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.27.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.661 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.26.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.733 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.25.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.781 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.24.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.824 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.23.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.886 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.22.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:21.936 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.21.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.009 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.20.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.064 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.2.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.108 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.19.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.158 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.18.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.236 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.17.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.295 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.16.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.374 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.15.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.452 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.14.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.535 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.13.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.579 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.12.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.632 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.11.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.690 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.10.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.738 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.1.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.793 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.0.linear1.weight shape '[21504, 3072]' is invalid for input of size 339738624
2026-01-13 16:19:22.837 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.838 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.839 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.869 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.870 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.871 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.924 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.925 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:22.926 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.003 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.003 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.004 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.033 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.034 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.035 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.066 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.067 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.068 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.099 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.099 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.100 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.154 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.155 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.156 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.186 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.187 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.188 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.230 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.230 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.231 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.297 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.298 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.298 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.324 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.325 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.325 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.358 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.358 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.359 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.385 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.386 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.387 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.426 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.427 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.428 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.txt_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.498 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.498 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.499 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.img_attn.qkv.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:23.537 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.9.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.570 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.8.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.628 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.7.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.805 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.6.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.878 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.5.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.911 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.4.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:23.959 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.37.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.025 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.36.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.073 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.35.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.133 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.34.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.177 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.33.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.216 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.32.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.250 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.31.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.295 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.30.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.343 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.3.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.380 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.29.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.417 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.28.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.473 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.27.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.505 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.26.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.553 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.25.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.589 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.24.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.623 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.23.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.655 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.22.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.705 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.21.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.749 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.20.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.787 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.2.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.821 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.19.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.856 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.18.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.915 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.17.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:24.966 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.16.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.001 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.15.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.072 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.14.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.121 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.13.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.154 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.12.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.187 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.11.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.238 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.10.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.281 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.1.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.319 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.single_blocks.0.linear2.weight shape '[3072, 15360]' is invalid for input of size 150994944
2026-01-13 16:19:25.377 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.txt_in.weight shape '[3072, 4096]' is invalid for input of size 94371840
2026-01-13 16:19:25.400 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.time_in.out_layer.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.419 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.guidance_in.out_layer.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.451 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.471 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.7.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.507 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.529 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.6.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.554 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.578 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.5.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.602 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.623 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.4.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.644 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.665 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.3.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.684 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.703 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.2.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.726 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.748 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.1.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.769 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.txt_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.791 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.double_blocks.0.img_attn.proj.weight shape '[3072, 3072]' is invalid for input of size 37748736
2026-01-13 16:19:25.794 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.time_in.in_layer.weight shape '[3072, 256]' is invalid for input of size 1572864
2026-01-13 16:19:25.796 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.guidance_in.in_layer.weight shape '[3072, 256]' is invalid for input of size 1572864
2026-01-13 16:19:25.797 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.img_in.weight shape '[3072, 64]' is invalid for input of size 786432
2026-01-13 16:19:25.799 [Debug] [ComfyUI-0/STDERR] ERROR lora diffusion_model.final_layer.linear.weight shape '[64, 3072]' is invalid for input of size 786432
2026-01-13 16:19:36.397 [Debug] [ComfyUI-0/STDERR] loaded completely; 85208.09 MB usable, 8763.64 MB loaded, full load: True
2026-01-13 16:19:36.415 [Debug] [ComfyUI-0/STDERR] 
2026-01-13 16:19:37.387 [Debug] [ComfyUI-0/STDERR]   0%|                                                                                                                                                                                                                                                       | 0/8 [00:00<?, ?it/s]
2026-01-13 16:19:37.651 [Debug] [ComfyUI-0/STDERR]  12%|█████████████████████████████▉                                                                                                                                                                                                                 | 1/8 [00:00<00:06,  1.03it/s]
2026-01-13 16:19:37.916 [Debug] [ComfyUI-0/STDERR]  25%|███████████████████████████████████████████████████████████▊                                                                                                                                                                                   | 2/8 [00:01<00:03,  1.80it/s]
2026-01-13 16:19:38.180 [Debug] [ComfyUI-0/STDERR]  38%|█████████████████████████████████████████████████████████████████████████████████████████▋                                                                                                                                                     | 3/8 [00:01<00:02,  2.37it/s]
2026-01-13 16:19:38.449 [Debug] [ComfyUI-0/STDERR]  50%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▌                                                                                                                       | 4/8 [00:01<00:01,  2.78it/s]
2026-01-13 16:19:38.719 [Debug] [ComfyUI-0/STDERR]  62%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▍                                                                                         | 5/8 [00:02<00:00,  3.06it/s]
2026-01-13 16:19:38.985 [Debug] [ComfyUI-0/STDERR]  75%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▎                                                           | 6/8 [00:02<00:00,  3.25it/s]
2026-01-13 16:19:39.249 [Debug] [ComfyUI-0/STDERR]  88%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏                             | 7/8 [00:02<00:00,  3.40it/s]
2026-01-13 16:19:39.249 [Debug] [ComfyUI-0/STDERR] 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:02<00:00,  3.52it/s]
2026-01-13 16:19:39.249 [Debug] [ComfyUI-0/STDERR] 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:02<00:00,  2.82it/s]
2026-01-13 16:19:39.250 [Debug] [ComfyUI-0/STDERR] Requested to load AutoencodingEngine
2026-01-13 16:19:39.283 [Debug] [ComfyUI-0/STDERR] loaded completely; 73102.22 MB usable, 159.87 MB loaded, full load: True
2026-01-13 16:19:39.707 [Debug] [ComfyUI-0/STDERR] Prompt executed in 20.96 seconds
2026-01-13 16:19:39.818 [Debug] Saved an output file as '/workspace/SwarmUI/Output/local/raw/2026-01-13/1616002-super fast car-FLUX_Dev_Kontext_NVFP4.png'
2026-01-13 16:19:40.067 [Info] Generated an image in 3.14 min (prep) and 20.96 sec (gen)```

FurkanGozukara · 2026-01-13T16:38:05Z

tested flux 1 and it worked fine

Make loras work on nvfp4 models.

77bbb5a

The initial applying is a bit slow but will probably be sped up in the future.

comfyanonymous requested review from Kosinkadink and guill as code owners January 13, 2026 03:25

Remove comment.

42a0cfc

comfyanonymous merged commit b3c0e4d into master Jan 13, 2026
14 checks passed

comfyanonymous deleted the temp_pr branch January 13, 2026 03:33

This was referenced Jan 13, 2026

It looks like LoRAs don't work at the moment with NVFP4 #11670

Closed

plz make nvfp4 support lora #11806

Closed

ahelme mentioned this pull request Jan 31, 2026

Changelogs for Migration: ComfyUI v0.8.1 through to ComfyUI v0.11.1 ahelme/comfy-multi#26

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Make loras work on nvfp4 models.#11837

Make loras work on nvfp4 models.#11837
comfyanonymous merged 2 commits intomasterfrom
temp_pr

comfyanonymous commented Jan 13, 2026

Uh oh!

Uh oh!

xueqing0622 commented Jan 13, 2026 •

edited

Loading

Uh oh!

FurkanGozukara commented Jan 13, 2026 •

edited

Loading

Uh oh!

FurkanGozukara commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

comfyanonymous commented Jan 13, 2026

Uh oh!

Uh oh!

xueqing0622 commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

FurkanGozukara commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

FurkanGozukara commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

xueqing0622 commented Jan 13, 2026 •

edited

Loading

FurkanGozukara commented Jan 13, 2026 •

edited

Loading