Add support architecture HeliumForCausalLM #11260
jenskastensson
started this conversation in
Ideas
Replies: 1 comment
-
Note that we released Helium 1 which uses the same architecture as llama |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Helium-1 preview model cannot be directly used with llama.cpp because it uses a new architecture called HeliumForCausalLM.
https://huggingface.co/kyutai/helium-1-preview-2b
Beta Was this translation helpful? Give feedback.
All reactions