known-good-models.md

Known-good models

The following models have been tested and are known to work with llm.

GPT-2

• https://huggingface.co/concedo/cerebras-2.7b-ggml

GPT-J

• https://huggingface.co/Kastor/GPT-J-6B-Pygway-ggml-q4_1

LLaMA

We have chosen not to include any models here until we have a better understanding of the licensing situation.

GPT-NeoX/RedPajama

• https://huggingface.co/oeathus/stablelm-base-alpha-7b-ggml-q4
• https://huggingface.co/keldenl/RedPajama-INCITE-Chat-7B-v0.1-GGML

BLOOM

• https://huggingface.co/nouamanetazi/bloomz-560m-ggml