Skip to content

Commit 3d47865

Browse files
committed
disable reload
Signed-off-by: yiliu30 <yi4.liu@intel.com>
1 parent 4b1a6e7 commit 3d47865

File tree

2 files changed

+2
-0
lines changed
  • examples/pytorch/nlp/huggingface_models/language-modeling/quantization/auto_round

2 files changed

+2
-0
lines changed

examples/pytorch/nlp/huggingface_models/language-modeling/quantization/auto_round/deepseek/quantize.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -68,6 +68,7 @@ def quant_model(args):
6868
fp_layers=config["fp_layers"],
6969
export_format=export_format,
7070
output_dir=output_dir,
71+
reloading=False,
7172
)
7273

7374
# quantizer execute

examples/pytorch/nlp/huggingface_models/language-modeling/quantization/auto_round/qwen/quantize.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,6 +69,7 @@ def quant_model(args):
6969
disable_opt_rtn=True,
7070
low_gpu_mem_usage=True,
7171
output_dir=output_dir,
72+
reloading=False,
7273
)
7374

7475
# quantizer execute

0 commit comments

Comments
 (0)