Skip to content

Commit d48a78f

Browse files
committed
docs(user): distinguish plain GKE H100 inference from the dynamo variant
The inference row implied every GKE H100 inference recipe carries performance floors that a smaller shape can false-fail. h100-gke-cos-inference declares no performance section at all; the floors live only in the -dynamo child. Say which is which so the row does not invent a gate the plain recipe lacks. Signed-off-by: Yuan Chen <yuanchen97@gmail.com>
1 parent e42e972 commit d48a78f

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

docs/user/cli-reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -528,7 +528,7 @@ and only the performance gates are affected.
528528
| Accelerator | Service / intent | Qualified machine type | On other shapes of the same GPU |
529529
|---|---|---|---|
530530
| `h100` | `gke`, `training` | `a3-megagpu-8g` | **Components do not schedule.** The GPUDirect-TCPXO DaemonSets pin node affinity to `cloud.google.com/gke-accelerator: nvidia-h100-mega-80gb`, so on `a3-highgpu-*` / `a3-edgegpu-8g` nothing rolls out and the deployment health check fails. AICR ships no GPUDirect-TCPX component for the shapes that need one — tracked in [#2290](https://github.com/NVIDIA/aicr/issues/2290). |
531-
| `h100` | `gke`, `inference` | `a3-megagpu-8g` | Deploys. The inference lineage carries no `gke-nccl-tcpxo` component, so the hard failure above does not apply; the inference floors are calibrated on the 8-GPU node, so smaller shapes such as `a3-highgpu-1g/2g/4g` can false-fail. |
531+
| `h100` | `gke`, `inference` | `a3-megagpu-8g` | Deploys. The inference lineage carries no `gke-nccl-tcpxo` component, so the hard failure above does not apply. Plain `inference` declares no performance gates at all; the `dynamo` variant adds floors calibrated on the 8-GPU node, so smaller shapes such as `a3-highgpu-1g/2g/4g` can false-fail there. |
532532
| `h100` | `eks` | `p5.48xlarge` (8× H100 SXM, 32× EFA) | Deploys, but performance floors are calibrated on the full node; smaller shapes such as `p5.4xlarge` can false-fail a healthy run. |
533533
| `h100` | `aks` | `Standard_ND96isr_H100_v5` (8× H100 SXM) | Deploys, but as above; `Standard_NC80adis_H100_v5` (2 GPUs) and `Standard_NC40ads_H100_v5` (1 GPU) can false-fail performance gates. |
534534
| `gb200` | `eks` | `p6e-gb200.36xlarge` (4 GPUs per K8s node) | Deploys; floors are sized for this shape and are themselves provisional pending production NVL72 data. |

0 commit comments

Comments
 (0)