Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PPDiffusers]add t2v model #5529

Merged
merged 9 commits into from
Apr 12, 2023
Merged

[PPDiffusers]add t2v model #5529

merged 9 commits into from
Apr 12, 2023

Conversation

westfish
Copy link
Contributor

@westfish westfish commented Apr 4, 2023

PR types

New features

PR changes

Models

Description

推理脚本:

import paddle
from ppdiffusers import TextToVideoSDPipeline
from ppdiffusers.utils import export_to_video

pipe = TextToVideoSDPipeline.from_pretrained(
    "damo-vilab/text-to-video-ms-1.7b", 
    from_hf_hub=True,
    from_diffusers=True
)
prompt = "Spiderman is surfing"

video_frames = pipe(prompt).frames
video_path = export_to_video(video_frames, output_video_path='spider_man.mp4')

生成效果如下:

2j5y7-pz3mt

@paddle-bot
Copy link

paddle-bot bot commented Apr 4, 2023

Thanks for your contribution!

@codecov
Copy link

codecov bot commented Apr 4, 2023

Codecov Report

Merging #5529 (f891fd5) into develop (c682b3f) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop    #5529   +/-   ##
========================================
  Coverage    59.42%   59.43%           
========================================
  Files          482      482           
  Lines        68103    68122   +19     
========================================
+ Hits         40473    40486   +13     
- Misses       27630    27636    +6     

see 15 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@westfish westfish requested a review from guoshengCS April 4, 2023 09:47
@guoshengCS guoshengCS requested a review from JunnYu April 6, 2023 02:10
@westfish
Copy link
Contributor Author

westfish commented Apr 6, 2023

review相关部分已全部修改

Copy link
Member

@JunnYu JunnYu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JunnYu JunnYu merged commit d6e316a into PaddlePaddle:develop Apr 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants