Issues with Amazon Bedrock cross-region inference

[xsayedmahmud]

I'm trying to use the Amazon Bedrock provider with the AI SDK to implement cross-region inference, but I'm encountering some difficulties. Here's what I've done so far:

1. I've installed the SDK using pnpm add @ai-sdk/amazon-bedrock.
2. I've set up my environment variables for AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, and AWS_REGION.
3. I've verified that my IAM user has the AmazonBedrockFullAccess policy.
4. I've confirmed in the Amazon Bedrock console that I have access to the base model.

In my API route, I'm using code similar to this:

import { bedrock } from "@ai-sdk/amazon-bedrock";

export async function POST(req: Request) {
  const { messages } = await req.json();

  const result = await streamText({
    model: bedrock("us.meta.llama3-2-90b-instruct-v1:0"), // Using the inference profile ID
    system: "",
    messages: convertToCoreMessages(messages),
  });

  return result.toDataStreamResponse();
}

However, I'm receiving an AccessDeniedException with the message "You don't have access to the model with the specified model ID."

My questions is does the streamText supports cross-region inference for Amazon Bedrock directly, or is there any additional setup needed?

I've tried using both the inference profile ID and ARN, but neither seems to work. Any guidance or suggestions would be greatly appreciated!

Thank you for your help!

[lgrammel]

Can you try using bedrockOptions instead and pass in a Bedrock configuration that works for you?

[xsayedmahmud]

Thanks for your reply and suggestion about using bedrockOptions. I wanted to update that the issue has been resolved now. It turns out the problem was on AWS's end. I reached out to AWS support, and they were able to fix it on their side.

[Montmorency]

Out of curiosity what was the issue they fixed? I am hitting the same error with all the same check lists on enabling model via console using the inference profile etc.

[xsayedmahmud]

Reach out to AWS technical support—they're excellent! They'll either fix the issue for you or guide you on how to resolve it.

[sflanker]

I'm not sure if this is the issue @xsayedmahmud but for anybody else winding up here: You need to be careful to be consistent with the region in which you "request access" to the Bedrock model and the region you specify when instantiating bedrock from @ai-sdk/amazon-bedrock.