Skip to content

Fix params4bit passing bnb quantized #1665

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

mklabunde
Copy link
Contributor

Fixes #1664

@matthewdouglas matthewdouglas added this to the v0.46.1 milestone Jun 2, 2025
@matthewdouglas matthewdouglas self-assigned this Jun 2, 2025
@matthewdouglas matthewdouglas added the Low Risk Risk of bugs in transformers and other libraries label Jun 2, 2025
Copy link

github-actions bot commented Jun 2, 2025

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@matthewdouglas matthewdouglas self-requested a review June 3, 2025 20:39
@matthewdouglas matthewdouglas merged commit cd8bd2d into bitsandbytes-foundation:main Jun 3, 2025
41 checks passed
@matthewdouglas
Copy link
Member

Thank you for reporting this and for fixing it! I can reproduce the original issue and the change here LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Low Risk Risk of bugs in transformers and other libraries
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Params4bit.to does not keep bnb_quantized status
2 participants