Add some models in ggml-models HF repo

[phymbert]

Motivation

In the context of:

• server: bench: continuous performance testing #6233

Need to add some models in the GGML HF Repo:

• mixtral8x7B Q4 Q8 F16 in split format
• bert-bge-large F16
• llama7B 13B split Q4 F16

[phymbert]

@ggerganov Georgi Hi, not urgent but if you could please assist here ? thanks

[phymbert]

I will do it when required

[phymbert]

@ggerganov Georgi, I have added phi-2 f16 but taking into account @julien-c recommandation to split the repo per model, tell me how do you want to proceeed taking into accounts files are used in server and bench CI workflows.

[ggerganov]

I was planning to migrate the models into separate repos over the next days. Meanwhile, the current models repo will stay as it is so that the CI keeps working. When the models have been migrated, we will update the CI and make the models repo private. When all CI is green, then we will delete the models repo

In case you want to help with that, feel free to start moving the models. Just create a repo with the name of the model as (e.h. ggml-org/phi-2) and move the files from models repo into the root dir of the new one

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.