Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

how to load checkpoint? #27

Closed
susht3 opened this issue Nov 17, 2018 · 4 comments
Closed

how to load checkpoint? #27

susht3 opened this issue Nov 17, 2018 · 4 comments

Comments

@susht3
Copy link

susht3 commented Nov 17, 2018 •
edited
Loading

i download the model from bert, it only has model.ckpt.data，model.ckpt.meta and model.ckpt.index, i donnot which to load, what is checkpoint file for convert.py?
@susht3
Copy link
Author

susht3 commented Nov 17, 2018

Converting TensorFlow checkpoint from ../dataset/bert/uncased_L-12_H-768_A-12/bert_model
Traceback (most recent call last):
File "convert_tf_checkpoint_to_pytorch.py", line 111, in
convert()
File "convert_tf_checkpoint_to_pytorch.py", line 60, in convert
init_vars = tf.train.list_variables(path)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/training/checkpoint_utils.py", line 95, in list_variables
reader = load_checkpoint(ckpt_dir_or_file)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/training/checkpoint_utils.py", line 64, in load_checkpoint
return pywrap_tensorflow.NewCheckpointReader(filename)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 326, in NewCheckpointReader
return CheckpointReader(compat.as_bytes(filepattern), status)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.NotFoundError: Unsuccessful TensorSliceReader constructor: Failed to find any matching files for ../dataset/bert/uncased_L-12_H-768_A-12/bert_model

@susht3 susht3 closed this as completed Nov 17, 2018
@maeotaku maeotaku mentioned this issue May 23, 2019
Closed
stevezheng23 added a commit to stevezheng23/transformers that referenced this issue Mar 24, 2020
@stevezheng23
Dev/zheng/quac (huggingface#28)
40c22a1 
* update kd-quac runner to support ensemble evaluation

* update kd-quac runner to support ensemble evaluation (cont.)

* fix kd issues in kd-quac runner

* update codalab submission pipeline to support single model & ensemble

* update codalab submission pipeline to support single model & ensemble (cont.)

* update codalab submission pipeline to support single model & ensemble (cont.)

* update codalab submission pipeline to support single model & ensemble (cont.) (huggingface#27)

* update codalab submission pipeline to support single model & ensemble (cont.)
@danyaljj
Copy link
Contributor

@susht3 what was your fix?

@dan-hu-spring
Copy link

I encountered a similar issue and didn't find a solution with ALBERT. I tried using the export_checkpoint.py file in ALBERT and sent that into the convert_tf_checkpoint_to_pytorch command and there was no error. However the resulting pytorch.bin output was unusable :\

@LysandreJik
Copy link
Member

@dan-hu-spring do you mind opening a new issue with your issue, so that we may take a look?

jameshennessytempus pushed a commit to jameshennessytempus/transformers that referenced this issue Jun 1, 2023
@jamesthesnake
Merge pull request huggingface#27 from jamesthesnake/ra
aa0be55 
Ra
@lwmlyy lwmlyy mentioned this issue Aug 15, 2023
Merged
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@danyaljj @susht3 @LysandreJik @dan-hu-spring