-
Notifications
You must be signed in to change notification settings - Fork 193
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flux.1 #1331
base: main
Are you sure you want to change the base?
Flux.1 #1331
Conversation
lazy mode w/o graph python text_to_image_generation.py \
--model_name_or_path black-forest-labs/FLUX.1-schnell \
--prompts "A cat holding a sign that says hello world" \
--num_images_per_prompt 1 \
--batch_size 1 \
--num_inference_steps 28 \
--image_save_dir /tmp/flux_1_images \
--scheduler flow_match_euler_discrete\
--use_habana \
--gaudi_config Habana/stable-diffusion \
--bf16 got output as following:
|
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
Signed-off-by: Daniel Socek <daniel.socek@intel.com> Co-authored-by: Deepak Narayana <deepak.narayana@intel.com>
graph mode: python text_to_image_generation.py \
--model_name_or_path black-forest-labs/FLUX.1-schnell \
--prompts "A cat holding a sign that says hello world" \
--num_images_per_prompt 1 \
--batch_size 1 \
--num_inference_steps 28 \
--image_save_dir /tmp/flux_1_images \
--scheduler flow_match_euler_discrete\
--use_habana \
--use_hpu_graphs \
--gaudi_config Habana/stable-diffusion \
--bf16 output:
python text_to_image_generation.py \
--model_name_or_path black-forest-labs/FLUX.1-schnell \
--prompts "A cat holding a sign that says hello world" \
--num_images_per_prompt 1 \
--batch_size 1 \
--num_inference_steps 4 \
--image_save_dir /tmp/flux_1_images \
--scheduler flow_match_euler_discrete\
--use_habana \
--use_hpu_graphs \
--gaudi_config Habana/stable-diffusion \
--bf16 output:
|
eager: PT_HPU_LAZY_MODE=0 \
python text_to_image_generation.py \
--model_name_or_path black-forest-labs/FLUX.1-schnell \
--prompts "A cat holding a sign that says hello world" \
--num_images_per_prompt 1 \
--batch_size 1 \
--num_inference_steps 28 \
--image_save_dir /tmp/flux_1_images \
--scheduler flow_match_euler_discrete\
--use_habana \
--gaudi_config Habana/stable-diffusion \
--bf16 output:
PT_HPU_LAZY_MODE=0 \
python text_to_image_generation.py \
--model_name_or_path black-forest-labs/FLUX.1-schnell \
--prompts "A cat holding a sign that says hello world" \
--num_images_per_prompt 1 \
--batch_size 1 \
--num_inference_steps 4 \
--image_save_dir /tmp/flux_1_images \
--scheduler flow_match_euler_discrete\
--use_habana \
--gaudi_config Habana/stable-diffusion \
--bf16
|
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
@regisss please help to review this PR. 28 inference steps: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please delete measure_all_500, measure_all etc. binary files like npz needn't be uploaded
Performance With Batching Enabled:
|
@ssarkar2 removed, pls review again |
What does this PR do?
adaption of diffuser.pipelines.FluxPipeline
Env:
Performance:
Fixes # (issue)
Before submitting