docs: add DeepSeek V4 Flash performance verification - #5724
Conversation
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
|
Light review: DeepSeek-V4-Flash verification card New model verification card plus matching entries in the validator throughput-input test dict. The card is well-formed and the five throughput metrics in test_validate_card.py are consistent with the recorded step times. Two things worth addressing:
Minor: verification_index.training.GB200 (lines 38-40) has a stray blank line 39 between the verified: and unsupported: keys. Cosmetic only. Suggested test cases
No perf tests impacted: this PR touches only a model verification card and the validator unit-test data, not any scripts/performance/configs/ recipe. |
| 0-31999 are within DSV4 vocab 0-129279; NullTokenizer is used). The run | ||
| completes 100 steps from random initialisation with finite loss, no skipped or | ||
| NaN iterations, and complete checkpoints at steps 50 and 100. Note: set | ||
| dataset.num_workers=0 to avoid NCCL pipeline timeout during data-loading on Lyris. |
There was a problem hiding this comment.
Privacy: "Lyris" reads as an execution-environment / cluster codename. The card skill explicitly forbids recording execution-environment names, and the point being made ("set dataset.num_workers=0 to avoid an NCCL pipeline timeout during data-loading") is portable — drop the cluster name. The validator doesn't catch this because it only matches the literal word cluster, but it still violates the skill's privacy boundary.
| dataset.num_workers=0 to avoid NCCL pipeline timeout during data-loading on Lyris. | |
| dataset.num_workers=0 to avoid NCCL pipeline timeout during data-loading. |
| context_parallel_size: 2 | ||
| command: > | ||
| ./scripts/training/train.sh --nodes 16 --gpus-per-node 4 | ||
| --recipe deepseek_v4_flash_sft_openmath_thinking_packed_gb200_config |
There was a problem hiding this comment.
The recipe deepseek_v4_flash_sft_openmath_thinking_packed_gb200_config does not exist on main. The registered SFT recipe is deepseek_v4_flash_sft_openmath_thinking_packed_config (no _gb200 suffix) — see src/megatron/bridge/recipes/deepseek/deepseek_v4.py:88. This same name is repeated at line 256 (sft_long_context). A user copy-pasting the command today would hit an unknown-recipe error. Please confirm the recipe name matches what's currently exported, or add the _gb200 variant.
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
|
Addressed in 41e0c4b: removed the private cluster codename and corrected both SFT commands to the exported |
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
|
Updated in 91ce65d after auditing current |
What does this PR do?
Adds the DeepSeek V4 Flash verification card and records verified pretraining-performance results from the canonical 128-GPU MXFP8 recipes.
The broader card content preserves the prior model-card work from #5360, with schema-required training throughput fields audited and completed.
Tracking: MB-1361
GB300 evidence: GitLab job 396937714
Testing
pre-commit run --all-filesgit diff --check