Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move convert.py to examples/convert-legacy-llama.py #7430

Merged
merged 13 commits into from
May 30, 2024
Merged

Move convert.py to examples/convert-legacy-llama.py #7430

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
dc24e7e
Move convert.py to examples/convert-no-torch.py
Galunid May 21, 2024
85e4e2b
Fix CI, scripts, readme files
Galunid May 21, 2024
88e06d0
convert-no-torch -> convert-legacy-llama
Galunid May 21, 2024
068d079
Move vocab thing to vocab.py
Galunid May 24, 2024
36558d9
Merge branch 'master' into move-convert-py
Galunid May 24, 2024
7b042f0
Fix convert-no-torch -> convert-legacy-llama
Galunid May 24, 2024
c48ccca
Fix lost convert.py in ci/run.sh
Galunid May 24, 2024
69729a3
Fix imports
Galunid May 24, 2024
8750900
Fix gguf not imported correctly
Galunid May 24, 2024
3cf7bdf
Fix flake8 complaints
Galunid May 24, 2024
a57484a
Fix check-requirements.sh
Galunid May 26, 2024
a72b757
Get rid of ADDED_TOKENS_FILE, FAST_TOKENIZER_FILE
Galunid May 26, 2024
55e6336
Review fixes
Galunid May 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix gguf not imported correctly
  • Loading branch information
@Galunid
Galunid committed May 24, 2024
commit 87509005a8675d6b60f246bf9f64b40834204ba7
4 changes: 3 additions & 1 deletion examples/convert-legacy-llama.py
View file
Open in desktop
Galunid marked this conversation as resolved.
Show resolved Hide resolved
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,9 @@
import numpy as np

if 'NO_LOCAL_GGUF' not in os.environ:
sys.path.insert(1, str(Path(__file__).parent / 'gguf-py'))
# use .parent.parent since we are in "examples" directory
sys.path.insert(1, str(Path(__file__).parent.parent / 'gguf-py'))

import gguf
from gguf import BaseVocab, Vocab, NoVocab, BpeVocab, SentencePieceVocab, LlamaHfVocab

Expand Down
Loading