Repository navigation
Conversation
…23, AI-125)
- Amazon Bedrock provider (v2): add "Choose a Bedrock endpoint" (runtime vs
mantle, format and auth guidance, mantle + bedrock-format validation rule)
and "Connect through a VPC endpoint" (vpc_endpoint, upstream_url precedence)
- New how-tos: route OpenAI traffic to Bedrock Mantle; connect to Bedrock
through a VPC endpoint (min_version ai-gateway 2.3)
- Amazon Bedrock provider (v1): add model.options.bedrock.vpc_endpoint
section for AI Proxy / AI Proxy Advanced, gateway version TODO
Open questions are left as {% comment %} TODO(reviewer) blocks.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
✅ Deploy Preview for kongdeveloper ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
This was
linked to
issues
Oct 7, 2026
This reverts commit 6a11152. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…e requests on Bedrock Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Resolves #7225
Summary
Docs proposal for two AI Gateway 2.3 GA features:
endpoint_type(runtime|mantle, defaultruntime) on the Bedrock target config.mantlesends requests tohttps://bedrock-mantle.{region}.api.awsand forwards OpenAI Chat Completions / Responses and Anthropic Messages bodies without translation. Amantletarget paired with abedrock-format AI Model is rejected.vpc_endpointon the shared Bedrock model config (chat/invoke targets and embeddings). Host-only override; Kong still builds Bedrock paths and streaming, and SigV4 signs for the real service and region.upstream_urlwins if both are set. Plugin-level equivalent ismodel.options.bedrock.vpc_endpoint.vpc_endpointwasn't documented anywhere onmainbefore this PR.Changes
app/ai-gateway/ai-providers/bedrock.md(v2): new sections Choose a Bedrock endpoint{% new_in 2.3 %}(Runtime vs Mantle table, when to use each, the validation rule, and SigV4 or bearer auth) and Connect through a VPC endpoint{% new_in 2.3 %}, each with anentity_example.app/_how-tos/ai-gateway/route-openai-traffic-to-bedrock-mantle.md(new,min_version: ai-gateway: '2.3')app/_how-tos/ai-gateway/connect-to-bedrock-through-vpc-endpoint.md(new,min_version: ai-gateway: '2.3')app/ai-gateway/v1/ai-providers/bedrock.md: shortmodel.options.bedrock.vpc_endpointsection for AI Proxy / AI Proxy Advanced. The gateway version is still a TODO.API proposal: https://github.com/Kong/platform-api/pull/3665 (
endpoint_type).vpc_endpointis already on platform-apimainvia #3543 (KOKO-4507).Open questions (also left in the pages as
{% comment %} TODO(reviewer)blocks)AI-123:
openai+generatefor Chat Completions,openai+agenticfor Responses)? Does Mantle support embeddings? Which Bedrock-specific APIs (Rerank, async invoke, batch) are Runtime-only?mantlefrom syncing to older DPs?AI-125:
vpc_endpointandupstream_urlare both set, is that a hard validation error or doesupstream_urlwin? The docs currently sayupstream_urlwins, matching the OAS description.aws_sts_endpoint_url")?vpc_endpointapply toendpoint_type: mantletoo, or only to Runtime?model.options.bedrock.vpc_endpointin AI Proxy / AI Proxy Advanced? This decides the v1 pagenew_intag. Drop that section if the plugin field ships later.Notes for reviewers
main, andapp/_data/products/ai-gateway.ymldoesn't list 2.3 yet. Retarget it to the AI Gateway 2.3 release branch once that branch exists.endpoint_typeandvpc_endpointwhenapi-specs/syncs from platform-api.Links
🤖 Generated with Claude Code