Skip to content

Commit 6edbe81

Browse files
Update convert_hf_to_gguf.py
Co-authored-by: compilade <git@compilade.net>
1 parent 9ba8fb6 commit 6edbe81

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2719,7 +2719,7 @@ def set_vocab(self):
27192719
for line in lines:
27202720
parts = line.split(' ')
27212721
assert len(parts) >= 3
2722-
_, token, token_len = int(parts[0]), ast.literal_eval(' '.join(parts[1:-1])), int(parts[-1])
2722+
token, token_len = ast.literal_eval(' '.join(parts[1:-1])), int(parts[-1])
27232723
token = token.encode("utf-8") if isinstance(token, str) else token
27242724
assert isinstance(token, bytes)
27252725
assert len(token) == token_len

0 commit comments

Comments
 (0)