Description
openedon Apr 21, 2024
Describe the feature you'd like to request
Allow administrator to set up access to multiple LLMs in nextcloud via proxy
Describe the solution you'd like
LITELLM does an incredible job of this.
Combination in Nextcloud would allow more options than the current OpenAI, LocalAI and Replicate options but would also provide a single AI abstraction layer and allow integration with Nextcloud user management, etc
LiteLLM's model aliases provide a useful way to have and call one proxy with unlimited Apis beneath.
The integration could allow integration with Nextcloud group permissions and tasks, allowing other apps to call the various AI models via alias and permissions through the abstraction layer.
If the aliases are exposed as bots then they could be called in Talk, etc
This dovetails with the following Nextcloud Assistant enhancement request - nextcloud/assistant#76
Describe alternatives you've considered
Currently calling LiteLLM via the Nextcloud LocalAI integration