File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -698,8 +698,10 @@ jobs:
698698 # Frontend cold-pulled the ~12GB vllm-runtime image on a CPU-pool node and
699699 # wedged in ContainerCreating past the readiness budget; phase_serve now
700700 # selects the GPU pool for both graph components, whose a3-megagpu-8g class
701- # pulls that image in a fraction of the budget. AWS/Azure serve steps stay
702- # commented until this lane demonstrates a served completion.
701+ # pulls that image in a fraction of the budget. The first GCP inference
702+ # nightly (or manual `run serve`) after this is the proving run — serving
703+ # was never verified end-to-end. AWS/Azure serve steps stay commented until
704+ # this lane demonstrates a served completion.
703705 - name : UAT - serve (DynamoGraphDeployment + endpoint)
704706 id : serve
705707 if : steps.conformance.outcome == 'success' && inputs.intent == 'inference'
Original file line number Diff line number Diff line change @@ -1398,10 +1398,13 @@ EOF
13981398
13991399phase_serve () {
14001400 # Deploy the served inference graph (Dynamo) — the intent=inference CUJ, the
1401- # DC3 counterpart of phase_train. Mirrors the DynamoGraphDeployment in
1402- # demos/cuj2-inference.md (demos/workloads/inference/vllm-agg.yaml): the KAI
1403- # queue and a two-component (Frontend + decode Worker) graph serving an
1404- # OpenAI-compatible endpoint. The worker requests its GPU as a scalar
1401+ # DC3 counterpart of phase_train. Graph topology mirrors the
1402+ # DynamoGraphDeployment in demos/cuj2-inference.md
1403+ # (demos/workloads/inference/vllm-agg.yaml): the KAI queue and a
1404+ # two-component (Frontend + decode Worker) graph serving an OpenAI-compatible
1405+ # endpoint. Frontend placement intentionally diverges — the demo pins
1406+ # nodeGroup=cpu-worker; this graph selects the GPU pool for both components
1407+ # (pool-selection note below, #1644). The worker requests its GPU as a scalar
14051408 # nvidia.com/gpu limit — the device-plugin production default (#1327).
14061409 #
14071410 # Tolerations are a portable SUPERSET of the taints across all UAT clusters
You can’t perform that action at this time.
0 commit comments