Skip to content

Commit

Permalink
cleanup (#180)
Browse files Browse the repository at this point in the history
Co-authored-by: LRL-ModelCloud <lrl@modelcloud.ai>
  • Loading branch information
LRL-ModelCloud and LRL-ModelCloud authored Jul 8, 2024
1 parent c945b35 commit d866208
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion gptqmodel/models/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -226,7 +226,7 @@ def _quantize(
if m.weight.shape[0] % 32 != 0 or m.weight.shape[1] % 32 != 0:
weight_config[n] = {"data_type": "fp"}
print(
f"{n} will not be quantized due to its shape not being divisible by 32, resulting in an exporting issue to autogptq")
f"{n} will not be quantized due to its shape not being divisible by 32, resulting in an exporting issue to gptqmodel")

if self.quantize_config.lm_head:
weight_config['lm_head'] = {"data_type": "int"}
Expand Down

0 comments on commit d866208

Please sign in to comment.