Skip to content

Commit 74749b4

Browse files
authored
docs(model-card): verify Nemotron 3 Super GB300 performance (#5719)
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
1 parent 84f41c4 commit 74749b4

2 files changed

Lines changed: 32 additions & 3 deletions

File tree

examples/model_verification_cards/nemotron-3-super-120b-a12b/card.yaml

Lines changed: 31 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,12 +4,13 @@
44
title: nemotron_3_super_120b_a12b
55
summary: >
66
Performance scope: pretrain_performance.H100 and pretrain_performance.GB200
7-
track tuned canonical 64-GPU performance recipes. Timing and throughput from
7+
and pretrain_performance.GB300 track tuned canonical 64-GPU performance
8+
recipes, with NVFP4 on GB300. Timing and throughput from
89
functional H100 and GB200 training are support-verification sanity checks
910
rather than optimized performance results. Hardware evidence is scoped
1011
strictly by accelerator. Nemotron 3 Super 120B-A12B verification covers
1112
conversion, inference, bounded real-data training, checkpoint resume, and
12-
canonical H100 and GB200 benchmarks.
13+
canonical H100, GB200, and GB300 benchmarks.
1314
verification_index:
1415
model_level:
1516
verified:
@@ -30,6 +31,7 @@ verification_index:
3031
performance:
3132
H100: verified
3233
GB200: verified
34+
GB300: verified
3335
model:
3436
hf_id: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16
3537
hf_revision: d51eab0d1f979ebc26b546e634a04f450d99158e # pragma: allowlist secret
@@ -702,4 +704,30 @@ items:
702704
11000 ms and at least 500 TFLOP/s/GPU, and the resolved configuration
703705
is persisted. Mock data and forced routing make the loss a finiteness
704706
check rather than convergence evidence. These numbers are GB200-only
705-
evidence and make no GB300 performance claim.
707+
evidence.
708+
709+
GB300:
710+
status: verified
711+
precision: nvfp4
712+
bridge_commit: 0480586879f2513958fd8634fc529693ae13e536 # pragma: allowlist secret
713+
command: >
714+
./scripts/training/train.sh --wait --nodes 16 --gpus-per-node 4
715+
--recipe nemotron_3_super_pretrain_64gpu_gb300_nvfp4_config
716+
--mode pretrain --max_steps 50 --seq_length 8192
717+
logger.save_config_filepath=work/model-verification/nemotron-3-super-120b-a12b/gb300-performance/ConfigContainer.yaml
718+
last_verified: 2026-08-18
719+
metrics:
720+
initial_loss: 12.17656
721+
final_loss: 0.01398012
722+
last_10_steps_step_time_ms_avg: 6357.940
723+
last_10_steps_model_tflops_per_gpu_avg: 873.330
724+
last_10_steps_tokens_per_second_per_gpu_avg: 10307.741
725+
expected_result: >
726+
On exactly 64 GB300s, the canonical NVFP4 mock-data recipe completes
727+
exactly 50 optimizer steps at TP1/PP1/CP1/EP64/ETP1, GBS/MBS 512/1,
728+
and sequence length 8192. All 50 keyed rows have finite loss with zero
729+
skipped or NaN iterations. Loss moves from 12.17656 to 0.01398012; the
730+
final ten steps average 6357.940 ms, 873.330 TFLOP/s/GPU, and
731+
10307.741 tokens/s/GPU. The resolved configuration persists. Mock data
732+
and forced routing make the loss a finiteness check rather than
733+
convergence evidence.

tests/unit_tests/skills/create_model_verification_card/test_validate_card.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,7 @@
6161
("nemotron-3-super-120b-a12b", "peft", "GB200"): (8192, 16, 16),
6262
("nemotron-3-super-120b-a12b", "pretrain_performance", "H100"): (4096, 1280, 64),
6363
("nemotron-3-super-120b-a12b", "pretrain_performance", "GB200"): (4096, 512, 64),
64+
("nemotron-3-super-120b-a12b", "pretrain_performance", "GB300"): (8192, 512, 64),
6465
("nemotron-3.5-lightning", "pretrain", "H100"): (8192, 512, 16),
6566
("nemotron-3.5-lightning", "pretrain", "GB200"): (8192, 512, 8),
6667
("nemotron-3.5-lightning", "pretrain_fsdp", "GB200", "bf16"): (8192, 512, 8),

0 commit comments

Comments
 (0)