样例 infer_pretrain.ipynb 在colab运行出错

[wukailu]

"""python
model = PeftModel.from_pretrained(model, "mymusise/chatGLM-6B-alpaca-lora")
"""
报错
"""
ValueError: We need an offload_dir to dispatch this model according to this device_map, the following
submodules need to be offloaded: base_model.model.transformer.layers.22, base_model.model.transformer.layers.23,
base_model.model.transformer.layers.24, base_model.model.transformer.layers.25,
base_model.model.transformer.layers.26, base_model.model.transformer.layers.27,
base_model.model.transformer.final_layernorm.
"""