Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow more authentication types #1972

Open
tarunwadhwa13 opened this issue Aug 7, 2024 · 1 comment
Open

Allow more authentication types #1972

tarunwadhwa13 opened this issue Aug 7, 2024 · 1 comment

Comments

@tarunwadhwa13
Copy link

Is your feature request related to a problem? Please describe.
Currently, Agenta mostly supports API Keys as authentication type for models which works for most vendors. However for self hosted models connecting to GCP (or in some cases even for AWS), there might be a requirement to provide info more than just the API Key (AWS for example requires specifying region name and GCP requires service json file)

Describe the solution you'd like
LiteLLM already supports using AWS specific env variables or GCP service account file.
I understand there might be a lot of complexities in current app design but this could give access to more enterprise models in a secure way

Enhancing the current LLM key design to choosing a dropdown for auth mechanism which could be passed to litellm. (Adds some vendor specific code though 😢)

Describe alternatives you've considered
No hacks yet. For AWS, you are bound to host on AWS ec2 only

@mmabrouk
Copy link
Member

Hi @tarunwadhwa13 , sorry for the late answer. This is planned for December.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants