Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

/examples/industrial_data_pretraining/paraformer/finetune.sh运行报错 #2078

Open
wuyuzhe opened this issue Sep 13, 2024 · 4 comments
Open
Labels
bug Something isn't working

Comments

@wuyuzhe
Copy link

wuyuzhe commented Sep 13, 2024

Notice: In order to resolve issues more efficiently, please raise issue following the template.
(注意:为了更加高效率解决您遇到的问题,请按照模板提问,补充细节)

🐛 Bug

  • RuntimeError: PytorchStreamReader failed locating file data/2: file not found

  • detail

    checkpoint = torch.load(ckpt, map_location="cpu")
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 789, in load
    checkpoint = torch.load(ckpt, map_location="cpu")
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 789, in load
    return _load(opened_zipfile, map_location, pickle_module, **pickle_load_args)
      File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1131, in _load
return _load(opened_zipfile, map_location, pickle_module, **pickle_load_args)
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1131, in _load
    result = unpickler.load()
      File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1101, in persistent_load
result = unpickler.load()
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1101, in persistent_load
    load_tensor(dtype, nbytes, key, _maybe_decode_ascii(location))
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1079, in load_tensor
    load_tensor(dtype, nbytes, key, _maybe_decode_ascii(location))
  File "/home/anaconda3/envs/py310/lib/python3.10/site-packages/torch/serialization.py", line 1079, in load_tensor
    storage = zip_file.get_storage_from_record(name, numel, torch.UntypedStorage).storage().untyped()
    RuntimeErrorstorage = zip_file.get_storage_from_record(name, numel, torch.UntypedStorage).storage().untyped(): 
PytorchStreamReader failed locating file data/2: file not found
RuntimeError: PytorchStreamReader failed locating file data/2: file not found

Environment

  • OS : centos7
  • FunASR: master code
  • ModelScope: 1.18.0
  • PyTorch Version: 1.13
  • How you installed funasr: pip
  • GPU (e.g., V100M32)
  • CUDA/cuDNN version: 11.6
  • python version: 3.10
@wuyuzhe wuyuzhe added the bug Something isn't working label Sep 13, 2024
@wuyuzhe
Copy link
Author

wuyuzhe commented Sep 13, 2024

model已经添加unused_parameters: true配置

@wanganddi0918
Copy link

Are the problems solved? I had the same problem

@wuyuzhe
Copy link
Author

wuyuzhe commented Sep 14, 2024

还没解决,可能是环境版本、代码版本、模型版本三方不匹配。还在试

@LauraGPT
Copy link
Collaborator

git lfs install
git clone model-xxx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants