Skip to content

AWS Bedrock via LiteLLM #620

Closed
Closed
@controldev

Description

@controldev

This may be a stupid question, but I tried using the LiteLLM model provider to use Claude via AWS Bedrock like this:

model = LitellmModel(
    model="bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0"
)

I can see authentication is done using the environment variables in the LiteLLM documentation.

What does the api_key parameter do? Is this only valid for certain inference providers (e.g. direct OpenAI)?

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionQuestion about using the SDK

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions