You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using ggml@f52d2a0 and am having trouble loading replit-code-v1-3b.
I used replit/convert-h5-to-ggml.py to convert to ggml f16.
Also created a q4_0 quantized version using replit-quantize.
However, when trying to load either of the models with replit
(e.g., ./bin/replit -m replit-code-v1-3b.f16.bin -p "def hello_world():")
I get:
replit_model_load: unknown tensor 'transformer.blocks.0.norm_1.weight' in model file
main: failed to load model from '/Users/matthias/.cache/ggml/replit-code-v1-3b.f16.bin'
Any ideas?
The text was updated successfully, but these errors were encountered:
I am using
ggml
@f52d2a0 and am having trouble loadingreplit-code-v1-3b
.I used
replit/convert-h5-to-ggml.py
to convert to ggml f16.Also created a q4_0 quantized version using
replit-quantize
.However, when trying to load either of the models with
replit
(e.g.,
./bin/replit -m replit-code-v1-3b.f16.bin -p "def hello_world():"
)I get:
Any ideas?
The text was updated successfully, but these errors were encountered: