You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs(user): correct issue references and section placement
Review found three defects in the previous commit.
#1256 and #1254 are closed as not-planned, so describing the normalized
performance floors as 'tracked in' them asserted follow-up work that was in
fact declined. Reword to state the decision: the floors are deliberately fixed
absolute full-node values, and running a qualified shape is how they pass.
The new section was inserted at the same heading level as 'Query Mode' and
before its examples block, so those examples rendered under the new heading.
Move the section after them, keeping it a sibling before 'Snapshot Mode'.
The gb200-eks-ubuntu-training comment said 'the performance floors below' but
that overlay carries none — they are inherited from gb200-eks-training, and are
provisional. Say so, and note the same on the table row.
Signed-off-by: Yuan Chen <yuanchen97@gmail.com>
Copy file name to clipboardExpand all lines: docs/user/cli-reference.md
+39-35Lines changed: 39 additions & 35 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -475,41 +475,6 @@ node shape the resolved recipe targets. See
475
475
476
476
> **Service / Accelerator / OS / Intent / Platform value listings above are the OSS-embedded set.** When `--data` registers additional values (e.g., undisclosed providers, proprietary platforms), the CLI admits them at runtime through the criteria registry — see [Data Extension](../integrator/data-extension.md). `--criteria-strict` restores the OSS-only set regardless of what `--data` contributes.
477
477
478
-
#### Qualified machine types
479
-
480
-
Each recipe is qualified against a specific node shape. Running it on another
481
-
machine type of the same GPU model is not blocked, but it is not qualified, and
482
-
the consequence differs by family.
483
-
484
-
| Accelerator | Service | Qualified machine type | On other shapes of the same GPU |
485
-
|---|---|---|---|
486
-
| `h100` | `gke` | `a3-megagpu-8g` | **Components do not schedule.** The GPUDirect-TCPXO DaemonSets pin node affinity to `cloud.google.com/gke-accelerator: nvidia-h100-mega-80gb`, so on `a3-highgpu-*` / `a3-edgegpu-8g` nothing rolls out and the deployment health check fails. GPUDirect-TCPX is not shipped — tracked in [#2290](https://github.com/NVIDIA/aicr/issues/2290). |
487
-
| `h100` | `eks` | `p5.48xlarge` (8× H100 SXM, 32× EFA) | Deploys, but performance floors are calibrated on the full node; smaller shapes such as `p5.4xlarge` can false-fail a healthy run. |
488
-
| `h100` | `aks` | `Standard_ND96isr_H100_v5` (8× H100 SXM) | Deploys, but as above; `Standard_NC80adis_H100_v5` (2 GPUs) and `Standard_NC40ads_H100_v5` (1 GPU) can false-fail performance gates. |
489
-
| `gb200` | `eks` | `p6e-gb200.36xlarge` (4 GPUs per K8s node) | Deploys; floors are sized for this shape. |
490
-
| `a100` | `gke` | `a2-highgpu-*` / `a2-ultragpu-*` | GPUDirect is not applicable; the `gke-nccl-tcpxo` component is intentionally omitted. |
491
-
| `b200` | `gke` | A4 shapes | No separate NCCL plugin installer; multi-node NCCL comes from GPU Operator `gdrcopy` plus GKE A4 native multi-NIC. |
492
-
493
-
Two distinct failure modes are worth separating:
494
-
495
-
- **Component-level (hard).** Only GKE H100 pins artifacts to a machine type
496
-
today. On a non-matching shape the DaemonSets have nowhere to land and
497
-
deployment validation fails loudly rather than degrading.
498
-
- **Performance-gate (soft).** Elsewhere the recipe deploys normally, but the
499
-
NCCL and inference floors are fixed absolute values calibrated on full,
500
-
high-bandwidth nodes. They are not normalized for GPU count or fabric class,
501
-
so a smaller shape can fail a gate while being perfectly healthy. See
502
-
[Validation › Node-shape assumption](./validation.md). Making these gates
503
-
fabric/transport-class aware is tracked in
504
-
[#1256](https://github.com/NVIDIA/aicr/issues/1256) and
Each recipe is qualified against a specific node shape. Running it on another
523
+
machine type of the same GPU model is not blocked, but it is not qualified, and
524
+
the consequence differs by family.
525
+
526
+
| Accelerator | Service | Qualified machine type | On other shapes of the same GPU |
527
+
|---|---|---|---|
528
+
| `h100` | `gke` | `a3-megagpu-8g` | **Components do not schedule.** The GPUDirect-TCPXO DaemonSets pin node affinity to `cloud.google.com/gke-accelerator: nvidia-h100-mega-80gb`, so on `a3-highgpu-*` / `a3-edgegpu-8g` nothing rolls out and the deployment health check fails. GPUDirect-TCPX is not shipped — tracked in [#2290](https://github.com/NVIDIA/aicr/issues/2290). |
529
+
| `h100` | `eks` | `p5.48xlarge` (8× H100 SXM, 32× EFA) | Deploys, but performance floors are calibrated on the full node; smaller shapes such as `p5.4xlarge` can false-fail a healthy run. |
530
+
| `h100` | `aks` | `Standard_ND96isr_H100_v5` (8× H100 SXM) | Deploys, but as above; `Standard_NC80adis_H100_v5` (2 GPUs) and `Standard_NC40ads_H100_v5` (1 GPU) can false-fail performance gates. |
531
+
| `gb200` | `eks` | `p6e-gb200.36xlarge` (4 GPUs per K8s node) | Deploys; floors are sized for this shape and are themselves provisional pending production NVL72 data. |
532
+
| `a100` | `gke` | `a2-highgpu-*` / `a2-ultragpu-*` | GPUDirect is not applicable; the `gke-nccl-tcpxo` component is intentionally omitted. |
533
+
| `b200` | `gke` | A4 shapes | No separate NCCL plugin installer; multi-node NCCL comes from GPU Operator `gdrcopy` plus GKE A4 native multi-NIC. |
534
+
535
+
Two distinct failure modes are worth separating:
536
+
537
+
- **Component-level (hard).** Only GKE H100 pins artifacts to a machine type
538
+
today. On a non-matching shape the DaemonSets have nowhere to land and
539
+
deployment validation fails loudly rather than degrading.
540
+
- **Performance-gate (soft).** Elsewhere the recipe deploys normally, but the
541
+
NCCL and inference floors are fixed absolute values calibrated on full,
542
+
high-bandwidth nodes. They are not normalized for GPU count or fabric class,
543
+
so a smaller shape can fail a gate while being perfectly healthy. See
544
+
[Validation › Node-shape assumption](./validation.md). Normalizing these
545
+
floors per GPU or per fabric class was considered and declined
0 commit comments