How to use Tile with FluxControlNetPipeline

[nitinmukesh]

I am using the following Controlnet and it supports 7 control modes, including canny (0), tile (1), depth (2), blur (3), pose (4), gray (5), low quality (6).
https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro

The diffuser code is also present in the above link.

I managed to integrate 3 (canny (0), depth (2), pose (4)) using
https://github.com/huggingface/controlnet_aux/
https://github.com/huggingface/image_gen_aux/

The other 3 (blur (3), gray (5), low quality (6)) also implemented.

I am now stuck with tile (1) implementation. I didn't find anything related here, or in controlnet_aux and image_gen_aux.

Checked Forge

How to implement Tile, any suggestions, plz?

[asomoza]

HI, if it follows what Tile does with SD and SDXL, it is used with just the source image, Tile was named like that because it helps when doing tiled inference but at the end, what it does, is just use the original image to guide the generation, so it helps with low quality images and also with upscaled images.

The usual way to use it with SDXL is to upscale the original image, then divide it but 1024x1024 tiles and do img2img with each tile using also the controlnet tile to add or improve the details.

I don't use controlnet with Flux so I'm can't be certain that is the same with it.

[nitinmukesh]

Thank you @asomoza

This one is a little difficult for me. I also tried various GPT but couldn't make it to work.
For now I removed the option. Maybe in future.