Deprecate kgateway in docs

Update repo and chart docs to steer users to standalone agentgateway. Mark the kgateway compatibility path as deprecated and slated for removal in the next llm-d release.

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

Author: danehans

README.md

@@ -8,8 +8,10 @@ This repository provides the Kubernetes infrastructure components, Helm charts,
 **Infrastructure Components:**
 
 - Helm charts for deploying llm-d gateway infrastructure
-- Kubernetes Gateway API configurations with support for Istio, kgateway,
+- Kubernetes Gateway API configurations with support for Istio,
   [agentgateway](https://agentgateway.dev/), and GKE
+- `kgateway` compatibility for inference, deprecated in favor of standalone
+  `agentgateway` and scheduled for removal in the next llm-d release
 - Service mesh integration and traffic management policies
 
 **Operational Tooling:**
@@ -25,7 +27,9 @@ This repository provides the Kubernetes infrastructure components, Helm charts,
 - Kubernetes 1.28+ cluster
 - Helm 3.10+
 - Gateway API v1.4.0+ installed
-- Gateway controller (Istio, kgateway, agentgateway, or GKE) deployed in your cluster
+- Gateway controller (Istio, agentgateway, or GKE) deployed in your cluster
+- `kgateway` remains supported as a deprecated compatibility option and will
+  be removed in the next llm-d release in favor of standalone `agentgateway`
 
 ### Install llm-d Infrastructure
 

charts/llm-d-infra/README.md

@@ -41,7 +41,8 @@ sudo mv kubectl /usr/local/bin/
 - Kubernetes 1.30+ (OpenShift 4.17+)
 - Helm 3.10+ or [latest release](https://github.com/helm/helm/releases)
 - [Gateway API v1.3.0](https://gateway-api.sigs.k8s.io/guides/) or [latest release](https://github.com/kubernetes-sigs/gateway-api/releases)
-- [Kgateway](https://kgateway.dev/) (or [Istio](http://istio.io/)) installed in the cluster (see for [examples](https://github.com/llm-d-incubation/llm-d-infra/blob/main/chart-dependencies/kgateway/install.sh) we use in our CI)
+- [agentgateway](https://agentgateway.dev/) (preferred) or [Istio](http://istio.io/) installed in the cluster
+- `kgateway` remains supported as a deprecated compatibility option and will be removed in the next llm-d release in favor of standalone `agentgateway`
 
 ## Usage
 
@@ -106,7 +107,7 @@ Kubernetes: `>= 1.28.0-0`
 | extraDeploy | Array of extra objects to deploy with the release | list | `[]` |
 | fullnameOverride | String to fully override common.names.fullname | string | `""` |
 | gateway | Gateway configuration | object | See below |
-| gateway.agentgateway | Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to "kgateway" or "agentgateway" | object | `{"env":[],"istio":{},"rawConfig":{},"shutdown":{}}` |
+| gateway.agentgateway | Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to "kgateway" or "agentgateway". Prefer "agentgateway"; "kgateway" is a deprecated compatibility alias and will be removed in the next llm-d release. | object | `{"env":[],"istio":{},"rawConfig":{},"shutdown":{}}` |
 | gateway.agentgateway.env | Additional environment variables for the agentgateway proxy | list | `[]` |
 | gateway.agentgateway.istio | Optional Istio integration settings for the agentgateway proxy | object | `{}` |
 | gateway.agentgateway.rawConfig | Raw agentgateway config merged into the generated configuration | object | `{}` |
@@ -115,12 +116,12 @@ Kubernetes: `>= 1.28.0-0`
 | gateway.destinationRule | see: https://istio.io/latest/docs/reference/config/networking/destination-rule/ | object | `{"enabled":false,"exportTo":[],"host":"localhost","subsets":[],"trafficPolicy":{},"workloadSelector":{}}` |
 | gateway.enabled | Deploy resources related to Gateway | bool | `true` |
 | gateway.fullnameOverride | String to fully override gateway.fullname | string | `""` |
-| gateway.gatewayClassName | Deprecated: "kgateway" and "agentgateway-v2" are mapped to "agentgateway". | string | `""` |
+| gateway.gatewayClassName | Deprecated: "kgateway" and "agentgateway-v2" are mapped to "agentgateway". The "kgateway" alias will be removed in the next llm-d release in favor of standalone "agentgateway". | string | `""` |
 | gateway.gatewayParameters.resources | Resource requests/limits <br /> Ref: https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#resource-requests-and-limits-of-pod-and-container | object | `{"limits":{"cpu":"2","memory":"1Gi"},"requests":{"cpu":"100m","memory":"128Mi"}}` |
 | gateway.labels | Additional labels provided to the Gateway resource | object | `{}` |
 | gateway.listeners | Set of listeners exposed via the Gateway, also propagated to the Ingress if enabled | list | `[{"allowedRoutes":{"namespaces":{"from":"All"}},"name":"default","port":80,"protocol":"HTTP"}]` |
 | gateway.nameOverride | String to partially override gateway.fullname | string | `""` |
-| gateway.provider | Defaults to "istio". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility. | string | `"istio"` |
+| gateway.provider | Defaults to "istio". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility. Deprecated: "kgateway" is a compatibility alias for standalone "agentgateway" and will be removed in the next llm-d release. | string | `"istio"` |
 | gateway.tls | TLS configuration for gateway | object | See below |
 | gateway.tls.referenceGrant | ReferenceGrant configuration for cross-namespace TLS certificate access | object | See below |
 | gateway.tls.referenceGrant.enabled | Enable ReferenceGrant creation (disabled by default) | bool | `false` |
@@ -147,5 +148,5 @@ Kubernetes: `>= 1.28.0-0`
 This chart deploys all infrastructure required to run the [llm-d](https://llm-d.ai/) project. It includes:
 
 - A Gateway
-- Gateway Parameters if Kgateway is chosen as a provider
+- AgentgatewayParameters for standalone agentgateway and the deprecated kgateway compatibility path
 - An optional ingress to sit in front of the gateway

charts/llm-d-infra/README.md.gotmpl

@@ -38,7 +38,8 @@ sudo mv kubectl /usr/local/bin/
 - Kubernetes 1.30+ (OpenShift 4.17+)
 - Helm 3.10+ or [latest release](https://github.com/helm/helm/releases)
 - [Gateway API v1.3.0](https://gateway-api.sigs.k8s.io/guides/) or [latest release](https://github.com/kubernetes-sigs/gateway-api/releases)
-- [Kgateway](https://kgateway.dev/) (or [Istio](http://istio.io/)) installed in the cluster (see for [examples](https://github.com/llm-d-incubation/llm-d-infra/blob/main/chart-dependencies/kgateway/install.sh) we use in our CI)
+- [agentgateway](https://agentgateway.dev/) (preferred) or [Istio](http://istio.io/) installed in the cluster
+- `kgateway` remains supported as a deprecated compatibility option and will be removed in the next llm-d release in favor of standalone `agentgateway`
 
 ## Usage
 
@@ -96,5 +97,5 @@ The command removes all the Kubernetes components associated with the chart and
 This chart deploys all infrastructure required to run the [llm-d](https://llm-d.ai/) project. It includes:
 
 - A Gateway
-- Gateway Parameters if Kgateway is chosen as a provider
+- AgentgatewayParameters for standalone agentgateway and the deprecated kgateway compatibility path
 - An optional ingress to sit in front of the gateway

charts/llm-d-infra/templates/NOTES.txt

@@ -9,8 +9,9 @@ $ helm status {{ .Release.Name }} -n {{ .Release.Namespace }}
 $ helm get all {{ .Release.Name }} -n {{ .Release.Namespace }}
 ```
 
-{{- if or (eq .Values.gateway.gatewayClassName "kgateway") (eq .Values.gateway.gatewayClassName "agentgateway-v2") }}
+{{- if or (eq .Values.gateway.provider "kgateway") (eq .Values.gateway.gatewayClassName "kgateway") (eq .Values.gateway.gatewayClassName "agentgateway-v2") }}
 
-`gateway.gatewayClassName=kgateway` and `gateway.gatewayClassName=agentgateway-v2` are deprecated and are rendered as `agentgateway`.
-Set `gateway.provider=kgateway` or `gateway.provider=agentgateway` and leave `gateway.gatewayClassName` empty, or set it explicitly to `agentgateway`.
+`gateway.provider=kgateway`, `gateway.gatewayClassName=kgateway`, and `gateway.gatewayClassName=agentgateway-v2` are deprecated.
+Use standalone `agentgateway` instead. `kgateway` compatibility will be removed in the next llm-d release.
+Set `gateway.provider=agentgateway` and leave `gateway.gatewayClassName` empty, or set it explicitly to `agentgateway`.
 {{- end }}

charts/llm-d-infra/values.schema.json

@@ -51,7 +51,7 @@
             "properties": {
                 "agentgateway": {
                     "additionalProperties": false,
-                    "description": "Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to \"kgateway\" or \"agentgateway\"",
+                    "description": "Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to \"kgateway\" or \"agentgateway\". Prefer \"agentgateway\"; \"kgateway\" is a deprecated compatibility alias and will be removed in the next llm-d release.",
                     "properties": {
                         "env": {
                             "description": "Additional environment variables for the agentgateway proxy",
@@ -181,7 +181,7 @@
                 },
                 "gatewayClassName": {
                     "default": "",
-                    "description": "Deprecated: \"kgateway\" and \"agentgateway-v2\" are mapped to \"agentgateway\".",
+                    "description": "Deprecated: \"kgateway\" and \"agentgateway-v2\" are mapped to \"agentgateway\". The \"kgateway\" alias will be removed in the next llm-d release in favor of standalone \"agentgateway\".",
                     "required": [],
                     "title": "gatewayClassName"
                 },
@@ -398,7 +398,7 @@
                 },
                 "provider": {
                     "default": "istio",
-                    "description": "Defaults to \"istio\". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility.",
+                    "description": "Defaults to \"istio\". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility. Deprecated: \"kgateway\" is a compatibility alias for standalone \"agentgateway\" and will be removed in the next llm-d release.",
                     "enum": [
                         "",
                         "istio",

charts/llm-d-infra/values.schema.tmpl.json

@@ -51,7 +51,7 @@
       "properties": {
         "agentgateway": {
           "additionalProperties": false,
-          "description": "Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to \"kgateway\" or \"agentgateway\"",
+          "description": "Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to \"kgateway\" or \"agentgateway\". Prefer \"agentgateway\"; \"kgateway\" is a deprecated compatibility alias and will be removed in the next llm-d release.",
           "properties": {
             "env": {
               "description": "Additional environment variables for the agentgateway proxy",
@@ -181,7 +181,7 @@
         },
         "gatewayClassName": {
           "default": "",
-          "description": "Deprecated: \"kgateway\" and \"agentgateway-v2\" are mapped to \"agentgateway\".",
+          "description": "Deprecated: \"kgateway\" and \"agentgateway-v2\" are mapped to \"agentgateway\". The \"kgateway\" alias will be removed in the next llm-d release in favor of standalone \"agentgateway\".",
           "required": [],
           "title": "gatewayClassName"
         },
@@ -344,7 +344,7 @@
         },
         "provider": {
           "default": "istio",
-          "description": "Defaults to \"istio\". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility.",
+          "description": "Defaults to \"istio\". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility. Deprecated: \"kgateway\" is a compatibility alias for standalone \"agentgateway\" and will be removed in the next llm-d release.",
           "enum": [
             "",
             "istio",

charts/llm-d-infra/values.yaml

@@ -63,12 +63,14 @@ gateway:
   # @schema
   # -- Gateway implementation used by this chart to render provider-specific infrastructure.
   # -- Defaults to "istio". Set to empty to infer the implementation from gateway.gatewayClassName for backward compatibility.
+  # -- Deprecated: "kgateway" is a compatibility alias for standalone "agentgateway" and will be removed in the next llm-d release.
   provider: istio
 
   # -- Gateway class that determines the backend used
   # -- Leave empty to use the default class name for the selected provider.
   # -- With the default provider, this renders as "istio". With "kgateway" or "agentgateway", this renders as "agentgateway".
   # -- Deprecated: "kgateway" and "agentgateway-v2" are mapped to "agentgateway".
+  # -- The "kgateway" alias will be removed in the next llm-d release in favor of standalone "agentgateway".
   gatewayClassName: ""
 
   # @schema
@@ -114,6 +116,7 @@ gateway:
   # additionalProperties: false
   # @schema
   # -- Agentgateway-specific parameters rendered into AgentgatewayParameters when gateway.provider resolves to "kgateway" or "agentgateway"
+  # -- Prefer "agentgateway"; "kgateway" is a deprecated compatibility alias and will be removed in the next llm-d release.
   agentgateway:
     # @schema
     # type: array