Skip to content

How to use custom LLM Gateway having JWT authetication #652

Closed
@18-Rohit

Description

@18-Rohit

I want to use custom LLM gateway, but instead of having any API KEY, I am having JWT authentication in it.
Here is an example of how my config file looks like:

{
    "LLM_GATEWAY_TOKEN": <token>,
    "LLM_GATEWAY_URL": <url>,
    "JWT_TOKEN": "",
    "openai_model": "gpt-4o",
    "api_key": "EMPTY"
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionQuestion about using the SDK

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions