Skip to content

This is a study aim to transfer the single concept by using DIT model self-attention capablity

License

Notifications You must be signed in to change notification settings

TTPlanetPig/Comfyui_Object_Migration

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Migration Kit Overview

Contact Me

Platform Details
QQ Group 571587838
Bilibili Homepage
Civitai ttplanet
WeChat tangtuanzhuzhu

Project Introduction

This experimental project focuses on leveraging Stable Diffusion (SD) models for high-consistency object and character rendering. The methodology integrates advanced workflows such as ControlNet, DIT model, and latent-guided processes for superior control and consistency.


Modules

1. Clothing Migration Kit

Model Download: Clothing Migration LoRA

workflow Download: Cloth workflow

Feature Description
Consistent Clothing Migration Transfer clothing styles across reference images with high accuracy.
Cartoon to Realism Conversion Seamlessly convert cartoon clothing to realistic styles and vice versa.
Creative Design Control Adjust clothing similarity via weights to inspire creativity.

Image Examples:

Example 1 Example 2

2. 3D Figure Kit

Model Download: 3D Figure LoRA

workflow Download: Figure workflow

Feature Description
3D Conversion Transform 2D character designs into 3D printable figurines.
Pose Customization Adjust poses, expressions, and other dynamic features to suit your design needs.
Material and Texture Enhancements Ensure high fidelity in textures and details for professional-grade outputs.

Image Examples:

Placeholder 1 Placeholder 2

Future Plans

Task Details
Transfer Distinct Features Improve the migration of objects with unique attributes.
Complex Pattern Handling Develop models to manage intricate designs.
Face Transfer Implement face style migrations.
3D Enhancements Introduce automated rigging and advanced pose control for 3D figures.
Community Ideas Incorporate suggestions and use cases shared by users.

How to Use

Step Details
1. Install Install ComfyUI and required custom nodes.
2. Download Obtain the models from the Hugging Face Project.
3. Load Load the selected model into ComfyUI.
4. Workflow Use the provided workflow examples for your application.

Dependencies

Node Link
TTP Toolset ComfyUI_TTP_Toolset
Tag Node ComfyUI_JC2
Alimama Flux Alimama_flux_inpaint

Note: Ensure sufficient VRAM for high-complexity workflows. Use optimization tools like FluxExt-MZ if needed.


Contribute

Contributions and suggestions are welcome! Open an issue or submit a pull request with your ideas.


About

This is a study aim to transfer the single concept by using DIT model self-attention capablity

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages