Problem
The pack attaches external providers only over OpenAI Chat Completions + a bearer key, leaving most non-OpenAI backends unreachable — including Bedrock's Claude, Nova, and Llama, which Bedrock serves only over Converse.1 The bundled Envoy AI Gateway already implements the wire-schema translation and provider-specific auth (SigV4, Azure, GCP, workload identity) for these backends;23 the operator just never emits anything but schema: OpenAI + bearer. This is exposing existing capability, not building it.
Scope
- Make the provider's wire schema, addressing, and credential independent, explicitly selected axes instead of assumed OpenAI + hostname + bearer key.
- Keep existing OpenAI-compatible providers working unchanged.
- Add AWS Bedrock as the first backend: Converse models on both endpoints under existing group access, authenticated by workload identity (no static key).
- Make further backends (Azure, GCP Vertex, Anthropic direct, …) additive.2
How it's built is the implementer's call.
Acceptance criteria
Open questions
- Migrate the spec vs. keep the flat OpenAI fields alongside a typed block.
- Whether the resource name still fits a general provider abstraction.
Problem
The pack attaches external providers only over OpenAI Chat Completions + a bearer key, leaving most non-OpenAI backends unreachable — including Bedrock's Claude, Nova, and Llama, which Bedrock serves only over Converse.1 The bundled Envoy AI Gateway already implements the wire-schema translation and provider-specific auth (SigV4, Azure, GCP, workload identity) for these backends;23 the operator just never emits anything but
schema: OpenAI+ bearer. This is exposing existing capability, not building it.Scope
How it's built is the implementer's call.
Acceptance criteria
Open questions
Footnotes
AWS, API compatibility by models — https://docs.aws.amazon.com/bedrock/latest/userguide/models-api-compatibility.html : Chat Completions is checked only for OpenAI models; every Claude, Nova, and Llama row is Converse-only. Verified in us-west-2 (2026-08-26): the OpenAI endpoint returns
model_not_foundforus.anthropic.*/us.amazon.nova-*/us.meta.llama*, and succeeds only foropenai.gpt-oss-*. ↩Envoy AI Gateway, Supported Providers — https://aigateway.envoyproxy.io/docs/capabilities/llm-integrations/supported-providers/ : native-schema backends (OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, GCP Vertex AI, GCP Anthropic, Cohere) plus OpenAI-compatible providers. ↩ ↩2
Envoy AI Gateway, Connecting to AI Providers — https://aigateway.envoyproxy.io/docs/0.4/capabilities/llm-integrations/connect-providers/ : AWS credentials use the default chain including EKS Pod Identity and IRSA; specifying only a region uses workload identity with no static key. ↩