Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add del dropout op pass to jit pe enigne #45439

Merged
merged 2 commits into from
Aug 31, 2022

Conversation

zh794390558
Copy link
Contributor

@zh794390558 zh794390558 commented Aug 26, 2022

PR types

Performance optimization

PR changes

Others

Describe

  • baselien RTF 1.65
  • 1 thread RTF 0.83
  • del dropout RTF 0.68
  • improved 2.43x now

@paddle-bot
Copy link

paddle-bot bot commented Aug 26, 2022

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link
Contributor

@Aurelius84 Aurelius84 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Aurelius84 Aurelius84 merged commit 46bc06b into PaddlePaddle:develop Aug 31, 2022
@@ -74,6 +74,8 @@ PEEngine::PEEngine(const std::shared_ptr<FunctionInfo> &info,

void PEEngine::CreateGraphAndPE() {
framework::details::BuildStrategy build_strategy;
build_strategy.inference_ = true;
build_strategy.del_dropout_ = true;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里只需要build_strategy.inference_ = true 即可。
这里这样写会影响扩展性,因为JitLayer并没有假设「仅支持Inference」,如果后续JitLayer承担更多角色时,但又不需要对用户暴露额外的头文件概念(如 build_strategy),这里看起属于类似 hard code的写法。

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

后面的PR会提一个可配的选项,可以在那个PR再讨论下

@zh794390558 zh794390558 deleted the jit_pass branch August 31, 2022 09:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants