Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DCU] fix llama inference bug on DCU #8815

Merged
merged 1 commit into from
Jul 29, 2024
Merged

Conversation

Deleter-D
Copy link
Contributor

@Deleter-D Deleter-D commented Jul 26, 2024

PR types

Bug fixes

PR changes

Models

Description

Some changes in PR 8800 affect the function of DCU in other inference scenarios, so restrictions are added to reduce the scope of impact.

The following scenarios have been tested on the DCU

  • dynamic
    • fp16
    • a8w8
    • a8w8c8
  • static
    • fp16
    • a8w8
    • a8w8c8

Copy link

paddle-bot bot commented Jul 26, 2024

Thanks for your contribution!

Copy link

codecov bot commented Jul 26, 2024

Codecov Report

Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 55.51%. Comparing base (5fd6dd2) to head (01163e0).
Report is 226 commits behind head on develop.

Files with missing lines Patch % Lines
...erimental/transformers/fused_transformer_layers.py 0.00% 1 Missing ⚠️
...dlenlp/experimental/transformers/llama/modeling.py 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #8815      +/-   ##
===========================================
+ Coverage    55.47%   55.51%   +0.04%     
===========================================
  Files          631      631              
  Lines        98468    99126     +658     
===========================================
+ Hits         54621    55031     +410     
- Misses       43847    44095     +248     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@DesmonDay DesmonDay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wawltor wawltor merged commit 5da5c36 into PaddlePaddle:develop Jul 29, 2024
10 of 12 checks passed
@Deleter-D Deleter-D deleted the bug_fix branch August 19, 2024 06:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants