Skip to content

Support stableCode models (which seems to be gpt-neo-x that we can convert into gguf) #4174

Closed
@maddes8cht

Description

@maddes8cht

Why can we build gpt-neo-x models with the convert-hf-to-gguf.py script when there is no code to run it?

Mentioned in #3838 an d #3293, we do have code to convert gpt-neo-x models into gguf models, but no code to run inference.

As i noticed, even the not too old stbilityAI stablecode models seems to be gpt-neo-x models, ad the convert-hf-to-gguf converts them, but there is no way to use them.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions