Skip to content
This repository was archived by the owner on Jun 20, 2026. It is now read-only.
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,8 @@ This repository provides the Kubernetes infrastructure components, Helm charts,

- Helm charts for deploying llm-d gateway infrastructure
- Kubernetes Gateway API configurations with support for Istio,
[agentgateway](https://agentgateway.dev/), and GKE
[agentgateway](https://agentgateway.dev/), GKE, and
[Envoy AI Gateway](https://aigateway.envoyproxy.io/)
- `kgateway` compatibility mode for inference, deprecated in favor of
standalone `agentgateway` and scheduled for removal in the next llm-d release
- Service mesh integration and traffic management policies
Expand All @@ -27,7 +28,7 @@ This repository provides the Kubernetes infrastructure components, Helm charts,
- Kubernetes 1.28+ cluster
- Helm 3.10+
- Gateway API v1.4.0+ installed
- Gateway controller (Istio, agentgateway, or GKE) deployed in your cluster
- Gateway controller (Istio, agentgateway, GKE, or Envoy AI Gateway) deployed in your cluster
- `kgateway` remains supported as a deprecated compatibility mode and install
path and will be removed in the next llm-d release in favor of standalone
`agentgateway`
Expand Down
2 changes: 1 addition & 1 deletion charts/llm-d-infra/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ sudo mv kubectl /usr/local/bin/
- Kubernetes 1.30+ (OpenShift 4.17+)
- Helm 3.10+ or [latest release](https://github.com/helm/helm/releases)
- [Gateway API v1.3.0](https://gateway-api.sigs.k8s.io/guides/) or [latest release](https://github.com/kubernetes-sigs/gateway-api/releases)
- [agentgateway](https://agentgateway.dev/) or [Istio](http://istio.io/) installed in the cluster
- [agentgateway](https://agentgateway.dev/), [Istio](http://istio.io/), or [Envoy AI Gateway](https://aigateway.envoyproxy.io/) installed in the cluster
- `kgateway` remains supported as a deprecated compatibility mode and install path and will be removed in the next llm-d release in favor of standalone `agentgateway`

## Usage
Expand Down
2 changes: 1 addition & 1 deletion charts/llm-d-infra/README.md.gotmpl
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ sudo mv kubectl /usr/local/bin/
- Kubernetes 1.30+ (OpenShift 4.17+)
- Helm 3.10+ or [latest release](https://github.com/helm/helm/releases)
- [Gateway API v1.3.0](https://gateway-api.sigs.k8s.io/guides/) or [latest release](https://github.com/kubernetes-sigs/gateway-api/releases)
- [agentgateway](https://agentgateway.dev/) or [Istio](http://istio.io/) installed in the cluster
- [agentgateway](https://agentgateway.dev/), [Istio](http://istio.io/), or [Envoy AI Gateway](https://aigateway.envoyproxy.io/) installed in the cluster
- `kgateway` remains supported as a deprecated compatibility mode and install path and will be removed in the next llm-d release in favor of standalone `agentgateway`

## Usage
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Resolve the logical gateway provider used for provider-specific rendering.
{{- define "gateway.provider" -}}
{{- $provider := .Values.gateway.provider | default "" -}}
{{- $className := .Values.gateway.gatewayClassName | default "" -}}
{{- $supported := list "istio" "kgateway" "agentgateway" "gke-l7-regional-external-managed" -}}
{{- $supported := list "istio" "kgateway" "agentgateway" "gke-l7-regional-external-managed" "envoy-ai-gateway" -}}
{{- if and $provider (not (has $provider $supported)) -}}
{{- fail (printf "unsupported gateway.provider %q" $provider) -}}
{{- end -}}
Expand All @@ -30,6 +30,8 @@ Resolve the logical gateway provider used for provider-specific rendering.
istio
{{- else if eq $className "gke-l7-regional-external-managed" -}}
gke-l7-regional-external-managed
{{- else if eq $className "envoy-ai-gateway" -}}
envoy-ai-gateway
{{- else -}}
{{- fail (printf "gateway.provider must be set when using custom gateway.gatewayClassName %q" $className) -}}
{{- end -}}
Expand Down Expand Up @@ -71,7 +73,7 @@ Resolve the default exposure intent for the selected provider.
*/}}
{{- define "gateway.defaultExposureType" -}}
{{- $provider := include "gateway.provider" . -}}
{{- if or (eq $provider "kgateway") (eq $provider "agentgateway") (eq $provider "gke-l7-regional-external-managed") -}}
{{- if or (eq $provider "kgateway") (eq $provider "agentgateway") (eq $provider "gke-l7-regional-external-managed") (eq $provider "envoy-ai-gateway") -}}
external
{{- else -}}
internal
Expand Down
3 changes: 2 additions & 1 deletion charts/llm-d-infra/values.schema.json
Original file line number Diff line number Diff line change
Expand Up @@ -431,7 +431,8 @@
"istio",
"kgateway",
"agentgateway",
"gke-l7-regional-external-managed"
"gke-l7-regional-external-managed",
"envoy-ai-gateway"
],
"required": [],
"title": "provider"
Expand Down
3 changes: 2 additions & 1 deletion charts/llm-d-infra/values.schema.tmpl.json
Original file line number Diff line number Diff line change
Expand Up @@ -377,7 +377,8 @@
"istio",
"kgateway",
"agentgateway",
"gke-l7-regional-external-managed"
"gke-l7-regional-external-managed",
"envoy-ai-gateway"
],
"required": [],
"title": "provider"
Expand Down
2 changes: 1 addition & 1 deletion charts/llm-d-infra/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ gateway:

# @schema
# default: istio
# enum: ["",istio,kgateway,agentgateway,gke-l7-regional-external-managed]
# enum: ["",istio,kgateway,agentgateway,gke-l7-regional-external-managed,envoy-ai-gateway]
# @schema
# -- Gateway implementation used by this chart to render provider-specific infrastructure.
# -- Defaults to "istio". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility.
Expand Down