Skip to content

Commit ed6c69e

Browse files
committed
test(uat): document GPU Frontend pin vs demo and proving-run status
The serve graph matches the demo topology but not its cpu-worker Frontend placement. Spell that out, and note that the first GCP inference nightly is the proving run for #1644. Signed-off-by: Rohit Rajani <rorajani@nvidia.com>
1 parent 060a45e commit ed6c69e

2 files changed

Lines changed: 11 additions & 6 deletions

File tree

.github/workflows/uat-gcp.yaml

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -698,8 +698,10 @@ jobs:
698698
# Frontend cold-pulled the ~12GB vllm-runtime image on a CPU-pool node and
699699
# wedged in ContainerCreating past the readiness budget; phase_serve now
700700
# selects the GPU pool for both graph components, whose a3-megagpu-8g class
701-
# pulls that image in a fraction of the budget. AWS/Azure serve steps stay
702-
# commented until this lane demonstrates a served completion.
701+
# pulls that image in a fraction of the budget. The first GCP inference
702+
# nightly (or manual `run serve`) after this is the proving run — serving
703+
# was never verified end-to-end. AWS/Azure serve steps stay commented until
704+
# this lane demonstrates a served completion.
703705
- name: UAT - serve (DynamoGraphDeployment + endpoint)
704706
id: serve
705707
if: steps.conformance.outcome == 'success' && inputs.intent == 'inference'

tests/uat/lib/phases.sh

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1398,10 +1398,13 @@ EOF
13981398

13991399
phase_serve() {
14001400
# Deploy the served inference graph (Dynamo) — the intent=inference CUJ, the
1401-
# DC3 counterpart of phase_train. Mirrors the DynamoGraphDeployment in
1402-
# demos/cuj2-inference.md (demos/workloads/inference/vllm-agg.yaml): the KAI
1403-
# queue and a two-component (Frontend + decode Worker) graph serving an
1404-
# OpenAI-compatible endpoint. The worker requests its GPU as a scalar
1401+
# DC3 counterpart of phase_train. Graph topology mirrors the
1402+
# DynamoGraphDeployment in demos/cuj2-inference.md
1403+
# (demos/workloads/inference/vllm-agg.yaml): the KAI queue and a
1404+
# two-component (Frontend + decode Worker) graph serving an OpenAI-compatible
1405+
# endpoint. Frontend placement intentionally diverges — the demo pins
1406+
# nodeGroup=cpu-worker; this graph selects the GPU pool for both components
1407+
# (pool-selection note below, #1644). The worker requests its GPU as a scalar
14051408
# nvidia.com/gpu limit — the device-plugin production default (#1327).
14061409
#
14071410
# Tolerations are a portable SUPERSET of the taints across all UAT clusters

0 commit comments

Comments
 (0)