New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix] 'QuantLlamaDecoderLayer' object has no attribute 'model_attn' #48

Merged

ChenMnZ merged 1 commit into OpenGVLab:main from xingchensong:xcsong-fix-model_attn

Dec 27, 2023

Contributor

xingchensong commented Dec 27, 2023

if let is enabled, the attribute name used in smooth_and_quant_inplace should be self_attn


          [fix] AttributeError: 'QuantLlamaDecoderLayer' object has no attribut…

d53a385

…e 'model_attn'

Collaborator

ChenMnZ commented Dec 27, 2023

Thanks for your time for this PR. This is a significant mistake due to my omission.

ChenMnZ merged commit 0a6d4f9 into OpenGVLab:main

xingchensong deleted the xcsong-fix-model_attn branch

December 27, 2023 04:01

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet