-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add notice regarding AIO #33
Conversation
Signed-off-by: Simon L <szaimen@e.mail.de>
b6db0f7
to
cdf47c4
Compare
Does localAI actually have LLMs that are multilingual? |
I guess so see https://github.com/go-skynet/model-gallery/blob/main/index.yaml |
i heavily doubt it. To my knowledge there are no multilingual open source llms out there atm. integration_openai will simply query the llm to simulate machine translation, so this will fail with localAI, afaict |
I see. However the models of the translate app could potentially be used via local AI, right? |
I doubt it. How do you come to that conclusion? |
Because local AI uses debian as base. So why should it not be possible? |
Well, sure it can be implemented, but localAI only implements a subset of the models available on huggingface, AFAIK. See https://localai.io/model-compatibility/ - The Opus models by University Helsinki are using a Marian-NMT architecture which is not in that list. |
all right |
You could add the libretranslate container and integration to AIO, though. |
ah you mean as community container? Good idea! |
No description provided.