Skip to content

perf(recipe): tune Nemotron Omni H100 fine-tuning (#5524) #20960

perf(recipe): tune Nemotron Omni H100 fine-tuning (#5524)

perf(recipe): tune Nemotron Omni H100 fine-tuning (#5524) #20960

Triggered via push August 25, 2026 02:54
Status Success
Total duration 53m 37s
Artifacts 87

cicd-main.yml

on: push
pre-flight  /  pre-flight
17s
pre-flight / pre-flight
configure
5s
configure
Lint check
25s
Lint check
cicd-wait-in-queue
cicd-wait-in-queue
cicd-compute-build-matrix
5s
cicd-compute-build-matrix
Matrix: cicd-container-build
Matrix: cicd-unit-tests-core
Launch_Unit_Tests_Diffusion
2m 20s
Launch_Unit_Tests_Diffusion
generate-test-matrix
8s
generate-test-matrix
generate-gb200-test-matrix
8s
generate-gb200-test-matrix
Launch_Import_Check
38s
Launch_Import_Check
Matrix: cicd-functional-tests-l0
Matrix: cicd-functional-tests-l1
Matrix: cicd-functional-tests-l2
Matrix: cicd-functional-tests-flaky
Matrix: cicd-functional-tests-gb200-l0
Matrix: cicd-functional-tests-gb200-l1
Matrix: cicd-functional-tests-gb200-l2
Matrix: cicd-functional-tests-gb200-flaky
Nemo_CICD_Test
19s
Nemo_CICD_Test
Coverage_Fake
0s
Coverage_Fake
Matrix: Coverage
Fit to window
Zoom out
Zoom in

Annotations

174 warnings and 85 notices
cicd-container-build (gcp, us-east4-docker.pkg.dev/nv-projdgxchipp-20260113193621/megatron-bridge...
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/build-push-action@ca052bb54ab0790a636c9b5f226502c73d547a25, docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
cicd-container-build (aws, 766267172432.dkr.ecr.us-east-1.amazonaws.com, nemo-ci-aws-gpu-x2)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/build-push-action@ca052bb54ab0790a636c9b5f226502c73d547a25, docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Launch_Unit_Tests_Diffusion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Diffusion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_0
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_0
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_1
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_1
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Launch_Unit_Tests_Core_2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen3_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen3_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_gemma
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_gemma
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_llada15
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_llada15
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen35_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen35_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_stepfun
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_stepfun
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_decentralized_pg
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_decentralized_pg
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_glm
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_glm
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen3_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen3_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_gemma3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_gemma3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_callbacks
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_callbacks
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_kimi_k25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_kimi_k25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_deepseek_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_deepseek_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_megatron_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_megatron_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_flux
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_flux
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_gemma
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_gemma
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_qwen2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_distributed_save
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_distributed_save
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_dspark
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_dspark
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_llama_3b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_llama_3b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_glm
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_glm
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_qwen
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_qwen
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen3_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen3_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_llama_3b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_llama_3b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_tensor_inspect
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_tensor_inspect
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_megatron_mimo
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_megatron_mimo
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_local_checkpointing
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_local_checkpointing
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_resiliency
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_resiliency
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen35_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen35_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_models_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_wan_ckpt_conversion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_wan_ckpt_conversion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_pretrain
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_pretrain
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter_generate
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter_generate
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_vlm_inference
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_vlm_inference
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_kimi_k25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_kimi_k25_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_finetune
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_training_finetune
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_gemma3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_gemma3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_ministral3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_glm_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_stepfun
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_stepfun
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_nemotronh
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_nemotronh
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_gpt_oss
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen3_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_models_qwen3_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_vlm_inference
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_vlm_inference
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_qwen
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_qwen
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_qwen_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
L1_Launch_recipes_qwen_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_qwen_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
gb200_L1_Launch_recipes_qwen_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
Coverage (unit-test)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Coverage (e2e)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Result
✅ Launch_Unit_Tests_Diffusion — PASSED
Result
✅ Launch_Unit_Tests_Core — PASSED
Result
✅ Launch_Unit_Tests_Core — PASSED
Result
✅ Launch_Unit_Tests_Core — PASSED
Result
✅ L1_Launch_models_qwen3_omni — PASSED
Result
✅ L0_Launch_recipes_gemma — PASSED
Result
✅ L0_Launch_models_nemotron_omni — PASSED
Result
✅ L1_Launch_models_llada15 — PASSED
Result
✅ L1_Launch_models_qwen35_vl — PASSED
Result
✅ L0_Launch_recipes_deepseek — PASSED
Result
✅ L1_Launch_recipes_glm_vl — PASSED
Result
✅ L1_Launch_models_qwen25_vl — PASSED
Result
✅ L0_Launch_recipes_deepseek — PASSED
Result
✅ L0_Launch_recipes_llama_1b — PASSED
Result
✅ L1_Launch_models_stepfun — PASSED
Result
✅ L0_Launch_training_decentralized_pg — PASSED
Result
✅ L1_Launch_models_glm — PASSED
Result
✅ L0_Launch_recipes_perf_config — PASSED
Result
✅ L0_Launch_utils — PASSED
Result
✅ L0_Launch_converter_fsdp — PASSED
Result
✅ L0_Launch_models_deepseek — PASSED
Result
✅ L1_Launch_models_qwen3_vl — PASSED
Result
✅ L1_Launch_models_gemma3 — PASSED
Result
✅ L0_Launch_data — PASSED
Result
✅ L0_Launch_recipes_gemma4_vl — PASSED
Result
✅ L0_Launch_recipes_perf_config — PASSED
Result
✅ L0_Launch_training_callbacks — PASSED
Result
✅ L1_Launch_models_kimi_k25_vl — PASSED
Result
✅ L1_Launch_recipes_gpt_oss — PASSED
Result
✅ L0_Launch_recipes_deepseek_fsdp — PASSED
Result
✅ L0_Launch_megatron_fsdp — PASSED
Result
✅ L0_Launch_models_flux — PASSED
Result
✅ L1_Launch_recipes_glm_vl — PASSED
Result
✅ L1_Launch_models_ministral3 — PASSED
Result
✅ L0_Launch_models_gemma4_vl — PASSED
Result
✅ L1_Launch_recipes_gemma — PASSED
Result
✅ L1_Launch_models_qwen2 — PASSED
Result
✅ L0_Launch_training_distributed_save — PASSED
Result
✅ L0_Launch_training_dspark — PASSED
Result
✅ L0_Launch_models_qwen3 — PASSED
Result
✅ L1_Launch_models_glm_vl — PASSED
Result
✅ L1_Launch_recipes_ministral3 — PASSED
Result
✅ L0_Launch_models_nemotron_omni — PASSED
Result
✅ L1_Launch_recipes_llama_3b — PASSED
Result
✅ L0_Launch_recipes_llama_1b — PASSED
Result
✅ L0_Launch_recipes_gemma4_vl — PASSED
Result
✅ L1_Launch_models_glm — PASSED
Result
✅ L1_Launch_recipes_qwen — PASSED
Result
✅ L0_Launch_utils — PASSED
Result
✅ L1_Launch_recipes_nemotron_omni — PASSED
Result
✅ L1_Launch_models_qwen3_omni — PASSED
Result
✅ L0_Launch_models_deepseek — PASSED
Result
✅ L1_Launch_recipes_llama_3b — PASSED
Result
✅ L0_Launch_data — PASSED
Result
✅ L0_Launch_training_tensor_inspect — PASSED
Result
✅ L1_Launch_recipes_gpt_oss — PASSED
Result
✅ L0_Launch_training_megatron_mimo — PASSED
Result
✅ L0_Launch_training_local_checkpointing — PASSED
Result
✅ L0_Launch_training_resiliency — PASSED
Result
✅ L1_Launch_models_qwen35_vl — PASSED
Result
✅ L1_Launch_models_gpt_oss — PASSED
Result
✅ L0_Launch_wan_ckpt_conversion — PASSED
Result
✅ L0_Launch_training_pretrain — PASSED
Result
✅ L1_Launch_models_qwen25_vl — PASSED
Result
✅ L0_Launch_converter_generate — PASSED
Result
✅ L1_Launch_models_qwen2 — PASSED
Result
✅ L1_Launch_models_ministral3 — PASSED
Result
✅ L1_Launch_vlm_inference — PASSED
Result
✅ L1_Launch_models_kimi_k25_vl — PASSED
Result
✅ L0_Launch_training_finetune — PASSED
Result
✅ L1_Launch_models_gemma3 — PASSED
Result
✅ L1_Launch_recipes_ministral3 — PASSED
Result
✅ L1_Launch_models_glm_vl — PASSED
Result
✅ L0_Launch_models_qwen3 — PASSED
Result
✅ L0_Launch_converter — PASSED
Result
✅ L1_Launch_models_stepfun — PASSED
Result
✅ L1_Launch_recipes_nemotronh — PASSED
Result
✅ L1_Launch_models_gpt_oss — PASSED
Result
✅ L1_Launch_models_qwen3_vl — PASSED
Result
✅ L1_Launch_recipes_nemotron_omni — PASSED
Result
✅ L1_Launch_vlm_inference — PASSED
Result
✅ L0_Launch_converter — PASSED
Result
✅ L1_Launch_recipes_qwen — PASSED
Result
✅ L1_Launch_recipes_qwen_vl — PASSED
Result
✅ L1_Launch_recipes_qwen_vl — PASSED

Artifacts

Produced during runtime
Name Size Digest
coverage-e2e-32803134270-01438592-7153-4509-ac94-dd9cafbdadb3
430 KB
sha256:0d48256f645933f13a5a25a2d5e489f4907c8b51ccda6dd5ea301300cea70da4
coverage-e2e-32803134270-0a3660e5-669b-4bd8-83ad-90c3244bc077
286 KB
sha256:d7d007065a5495d05c00174e91fd5320ad25c3728c3f29a94f08c125857c5ed7
coverage-e2e-32803134270-0c682047-f665-48eb-8678-951ca942b014
388 KB
sha256:f782a79a36b1e57bebfa9cfdfe2502fd11dd746590c5ea24eeff7de084a9f4be
coverage-e2e-32803134270-0e0cfbe3-d244-4b30-abec-af4a8bf19162
854 KB
sha256:e9cec9de27aea6da22fe056ef8bd19d9fe94fc14d656e8d0724fe10bd3c41fd7
coverage-e2e-32803134270-0f8b63ca-515f-456d-8bd0-79f23aa3b875
359 KB
sha256:73f4a286d71ef4d5dfb31bcc4d235683819e5d26e319ed8621e9af15988d9acf
coverage-e2e-32803134270-11756cd8-0ecb-42db-92d4-5a69a1729572
286 KB
sha256:e3428f4067dd141656cd6910107be0ede890119e26cca44d1801910301059f27
coverage-e2e-32803134270-13276ff3-4275-442b-ac11-bc4536274cfe
312 KB
sha256:95eafe804e4e98cd2ed53ee3d693dfc87a00c72235a1ddf86ae2ffa2ba0e5fe0
coverage-e2e-32803134270-15a5f4bd-ddef-40c8-8c19-bac2903c7594
781 KB
sha256:fa7aa988ae1d0e14c1a1ae265253e6da01a74456361e7f0fc762b72e58e86211
coverage-e2e-32803134270-185f749b-ac40-47db-b90b-0ff26c7d8ff8
864 KB
sha256:d9a8346cd4a3f0625f00cc4e4cad8d0c34117c7addfee93a35386a48274059d3
coverage-e2e-32803134270-1c4ecd94-182f-41ea-8a13-610320b98706
432 KB
sha256:852dd464d8d5f2ad1d9109eaa9b2d4a0a53c98b6be77eba9a6ead16997aa1d19
coverage-e2e-32803134270-1d5047e8-21a8-41ef-ac1c-22ba35ca0318
784 KB
sha256:bafe9d6d5b243a2de3f7ffcf0278c8d4c76f212a499e40ed6f4520bc0bc2922c
coverage-e2e-32803134270-23ba9368-1d04-45ee-bb41-2c938ada03dc
1.29 KB
sha256:6b3f3e420545c7295edf4513b0b01a2e424547652ec7a169e6745da8b278ccf5
coverage-e2e-32803134270-23cd1219-ed52-49ca-b432-0c18880d8b54
784 KB
sha256:25e95f76a066e32928fbd55cc19224e43799d2b3f689851970600f1df0680fad
coverage-e2e-32803134270-319ec31d-8ec0-4b7f-aa9e-803daa60388d
782 KB
sha256:72ebfee59135bb46518163e97ccc9c4a08a394b298f8c1498b826b71901e22cf
coverage-e2e-32803134270-32b9cd57-5639-4b7e-b041-654e955ceb87
859 KB
sha256:0f3f7bdb0566c05105d6329d644c59d6256f6eafa1741714b34dfbfbb8442406
coverage-e2e-32803134270-354bd359-b758-4f1e-bfb3-6c879d73a4d4
399 KB
sha256:ad95a22451d43799ef123a797813b56a252a980eb674812ad6c731cf572843b5
coverage-e2e-32803134270-35c226eb-2585-4cee-b972-ee56f45e0a96
854 KB
sha256:7082cee05e1a8b8aff3cb2b7e47c9f8457f81bb4f8ac491adc28d88f79e3069c
coverage-e2e-32803134270-3afeefc4-71be-48e8-b8e7-15f19c534429
379 KB
sha256:1a973b18f62d7aecb88e30979df5bc91c45bcbc0e491e99ab2202ac6766abc04
coverage-e2e-32803134270-3ce125d6-802e-4c4d-98ad-7b91fee564f2
781 KB
sha256:5b88edd8fc13ddd59c3d771a976a9d7c28b2c4e81e635054f6b151f4aa2fd209
coverage-e2e-32803134270-3fd83414-70c9-42fd-bafe-34b3056646cd
783 KB
sha256:8c9279fa3f1c7690458b5ea286fc27d9930913a29d3e5a47185f3498461a2c5a
coverage-e2e-32803134270-43774234-b939-4a4d-9c08-c53df11e6477
379 KB
sha256:759b1ba75cce7d7c8b2f238dafa04563d06a2288f2c9a9e7ac16eebffc185719
coverage-e2e-32803134270-469187fd-b228-4da6-b37e-4165289372b9
781 KB
sha256:b602ed55fa307c8bd7111bbb94187f2ed030a3055e16c4a46bfc7162394a897f
coverage-e2e-32803134270-53889876-b06f-4202-a4db-f6fd4bcbee64
282 KB
sha256:d7f416cc4d66886d83ab71a27cc568543eb5d43361c0c167d178ca4528e1997a
coverage-e2e-32803134270-54de5815-82c4-49b1-b770-de149441f8b9
286 KB
sha256:1d0c888b33640bc13cfc211b1b1d7ba2581c81157acdd64886f34a532ed4b0a8
coverage-e2e-32803134270-587dad9f-85a0-48db-94d7-edb94598953b
386 KB
sha256:b64881f5975605fe8a59f5daf331c542ac22e5ecf13ba15798609aa0972c39b0
coverage-e2e-32803134270-5ba96530-61df-4f33-be5b-c2fa1fe552b9
312 KB
sha256:5110b17c28311a423f7debe5b116af2f0aeec4e28dfbd47688262083d45a1013
coverage-e2e-32803134270-5db1d64c-a5f7-4eea-947c-f75fc1e0a061
389 KB
sha256:ceefd64e95a99c4d5730a1357b498d4baa185ebc39bba3a749fbf12b5855564e
coverage-e2e-32803134270-61b8bc1e-e02e-4d80-a7b4-70e012bad876
388 KB
sha256:023687654fb0522f404e838a0cb57cac40b1cffdf0d3cecabbd647db59caeeb8
coverage-e2e-32803134270-62d8ee1f-dea1-4c77-a653-d50065044388
286 KB
sha256:0ca0d3ce821343037668b2eb9a1a268935ab0346433be5714c7ba165a0eac282
coverage-e2e-32803134270-667b3531-be6b-44d9-8532-17347294d06f
386 KB
sha256:713b41f1ed3bd34c95f107c451a5f987d42cf1d0fe5bb4f724fd35966077dfdd
coverage-e2e-32803134270-704c034e-07e4-4906-92bf-5519f294911f
286 KB
sha256:ba1ef8c942a5ccd68017915c3b034007f05b5507831e7cffa5f6909557619519
coverage-e2e-32803134270-766aad4d-86fa-445f-ab99-cbc0f9101e91
433 KB
sha256:dd5e803c5960719ca56eb71df4f05f7900dc72055489e6328601aeba73866fb2
coverage-e2e-32803134270-7728e2c2-7d80-462e-bc13-e5aa9411f512
282 KB
sha256:0a7b0987cdfc6e781303e5130e24cc5192c2ba361b2062e2391109b89b1ad00a
coverage-e2e-32803134270-783555b0-705f-4b58-acee-d4def23eb761
286 KB
sha256:fd5f00f7a2a9f33b335e404596cacc0eb92a1b979deef230b7147d1306797a9d
coverage-e2e-32803134270-7d0005af-e48e-4e43-9a1e-e405109d5de2
854 KB
sha256:c4a675bbfc4c47af9a90f11c7711a4eede8a04da969c143251e41be5354a8f3e
coverage-e2e-32803134270-7f0be0e9-ba64-4865-a054-963171a6bdaa
285 KB
sha256:9be220d7df98152925f7f0787d88131895f4be89ac1060d15fd57b3e18c81614
coverage-e2e-32803134270-826124f7-dd02-48c8-98dd-5503d281a1e6
800 KB
sha256:70cb2f4747968ebf7639e71224978e58dd14c502e75d27480e4d53e599a770ab
coverage-e2e-32803134270-82a79939-be29-46b7-aa99-81720e5d054a
286 KB
sha256:41867c83e967447c9ef687359ccca1204fd6285b79fdefda1989db468176eb8e
coverage-e2e-32803134270-84afb3d6-d90d-4411-933b-f59b6f54ea4d
430 KB
sha256:2acc1d93a3b735035962a27cef8860495e9f1f1459b8b559b5c750c09ab2b15e
coverage-e2e-32803134270-889367d1-79fb-4156-be78-8972d48fc47b
328 KB
sha256:b43680a496e343fcc80e63910792c0bedc3ef6143ea22966edc51c267da4988b
coverage-e2e-32803134270-8baaddde-32ed-49a7-aaad-66d7ee399bcc
784 KB
sha256:37edd5ef83f3dbc4d128216a3097345abf4c0213b05f3090fd1278c9c3ee0f90
coverage-e2e-32803134270-8da4464f-709f-41f2-91fd-63576ee15f92
785 KB
sha256:329360889e03d70ba0b1c46a36e52b88950cfaabeb9b407a8d331980a3cc3d43
coverage-e2e-32803134270-8dffaa4d-16c7-4d1f-9213-7ac64c0ae33e
359 KB
sha256:d1e39e4bb6d9482d6e36654ab54feb5f054375c11077278562c93c8acdc2611d
coverage-e2e-32803134270-8e4daffb-d946-4450-8977-78e8e2673871
389 KB
sha256:1dafa000f533a48f58681955eb8b7886de00b10e2f1b89fff44eef51ec2becf9
coverage-e2e-32803134270-8f1b1f87-41cf-4f9c-abed-39b2554506b6
783 KB
sha256:3b248eea0e6a512cce095bf28ffcbf9f6d263c2dda550cbe5d1b9c84f9478cdd
coverage-e2e-32803134270-925d564a-a1a6-4e92-b7b6-99faaffedf6d
285 KB
sha256:6ba5e0388e536a91abfa37fa03f638722fb354668f7cad163aee2b846aa71f46
coverage-e2e-32803134270-93975942-4c17-48e9-94cf-1e2b8bc6f924
416 KB
sha256:11d073c22fbd68a9ddccf3916fb87838079402e5f849342ee1ba45889128a6fb
coverage-e2e-32803134270-939bc158-f949-44ff-a325-7d0442225289
286 KB
sha256:2570566687dba71a776b1f8c470945a58c81dd7fdd344abe7ee7aa3bb53f1998
coverage-e2e-32803134270-99e64d47-0ebf-4298-86e8-5c9ab45aed81
329 KB
sha256:22c43412122320db0e8dd518419de46a7e2972f3478d4525b4af9750e7fcf604
coverage-e2e-32803134270-9f267cc3-fb6b-4968-adf9-46cd86c73718
433 KB
sha256:40a351fca3a8715c226fd81d55925bb0381a01a4e19292c923ff7870e3889565
coverage-e2e-32803134270-a02322db-9773-4a01-8774-b6eefa35221b
424 KB
sha256:f6ce890d7ee73c1b9245f1e2e0ebe49077092fc927fbcc9e99619d3b11655423
coverage-e2e-32803134270-a8b03bad-32e4-4491-8343-4383149f0d27
857 KB
sha256:b552944a94a21f581514043a79c5c87d099af4389f3bb1fb024d5f51161a9de8
coverage-e2e-32803134270-a9a03107-cc23-4a1c-8d6c-5abdf531f0d1
856 KB
sha256:24037c9b69fabce5ca3daea91081b00848b08e6bd7f3991f2ae35136c9261c64
coverage-e2e-32803134270-ac4c3552-74c5-470a-a98d-ca54b9cc9af8
313 KB
sha256:64b586b04cfe575ce5d72d20f772d9919fb09a1958f64217ed16cd56a971e063
coverage-e2e-32803134270-ad5c8fea-b055-417c-b6d5-c5951e34223b
338 KB
sha256:82fe2e174c0fac77f75e8970ea7b815a45afa35cee542c3047e8b90e82de996e
coverage-e2e-32803134270-ae6fb18c-141f-4fc2-80cb-e8f7e27e3a96
418 KB
sha256:83d4565445ba4bc4bbdd4baf600a6d19d3c67369d24e6474ec78236b255bad72
coverage-e2e-32803134270-af0af647-fbcd-47d3-8ef4-80c8d4803982
432 KB
sha256:8e361419485355184017cb6633d4376c34929ce445ba79524098518d957fd78c
coverage-e2e-32803134270-b1d1a726-ba1a-44a4-bcdc-2ada6b72b1e7
322 KB
sha256:c96521b442fc94f79e04d5df6912b861d669e122cf0b8a7bf8a4aba04ee3121a
coverage-e2e-32803134270-b5f49845-92f7-4463-8577-5ab1e7cbc31b
501 KB
sha256:a7203cff55e1377bbec1811d7bb1aaa59f669465d7c8300ae9105f1b290b7718
coverage-e2e-32803134270-b7ba94cd-e355-4154-b384-028d1dc348d0
852 KB
sha256:4b5b8db5b650532a70b850b588acfd0e35b26cacbded714e54c17b63754c8734
coverage-e2e-32803134270-b982a230-c822-40c9-876c-64fad4b2a698
855 KB
sha256:8d5a6f7c786c7e5f25163c0141c20234c72c464ac84259f185eabf631a0d7bfe
coverage-e2e-32803134270-ba1f6cb8-3cfc-444a-869c-08420aa815bd
328 KB
sha256:ffffaf48eec2dd7369087aa7751ff66208fa4cd66101e28f4b146ea89923aac3
coverage-e2e-32803134270-c07af8f5-d420-4409-a6c6-aced3a9afca4
857 KB
sha256:5a492c6de0757af7cafeac96f3f1f9fe9af9975f9fc84a150da7ef219abef08e
coverage-e2e-32803134270-c33dccd5-3ec5-4026-8e3a-bd68f3483d60
338 KB
sha256:15c24017f3ab32e90f190e4189629976142cf42b8b3232e8d56643e6b81cc406
coverage-e2e-32803134270-c3874955-2140-4ced-98cc-e2fcda34a90e
559 KB
sha256:2e80b638cd3fe564bb0acc96745959cc8e68e2f1d2029f1a709171966c3ca88c
coverage-e2e-32803134270-c3c648e2-1df0-42f7-a783-d105b640291b
782 KB
sha256:8cff58a010e4bf6eca4a12b1578371042583d06ddfee69674c27cb3b7f60c547
coverage-e2e-32803134270-c705ccce-785f-4ce8-b056-409152caafe9
424 KB
sha256:c8ea862c9214102cd9b3ecb5f3cabcf161befab019cdadff704f48046ed8058a
coverage-e2e-32803134270-c7acb96c-040d-46e4-9c08-3ee2e534c8b5
285 KB
sha256:678dcb5f499ed45e5000df4baadb25b878e063b822286008dffc91a08245f159
coverage-e2e-32803134270-cfb0c352-f32b-4060-a298-4d37a89fdaba
357 KB
sha256:8cf84b8db22275a9b7950bacfcb774a04d171c8e72d3e350c76e8f9b13432cbe
coverage-e2e-32803134270-d705df38-bb4f-4dcb-b360-aa516c1f1215
857 KB
sha256:4ed08e1d2964d3eea194bbc4381c817e4335fd483ee8a0c7f1ece94075493f3e
coverage-e2e-32803134270-d7edde46-93bd-4535-90b2-6566699e3463
330 KB
sha256:ccafebe9f9123e3d2f4d171a99ca352a75d956c7b9249b4b8610cde751118b54
coverage-e2e-32803134270-e1205c4f-5ab1-477f-8c0f-956cbfe7d005
784 KB
sha256:99e3f604f49c52447f2cbe9b9d006a20bed9b7f914ea121ad4c17f53d993ebb2
coverage-e2e-32803134270-e24ec242-2f68-48ca-beed-8ef3abfc83cd
783 KB
sha256:c91e4a72d63249d57ddae6317f3f80d3d975cfacc5e65d144e854df4b318c800
coverage-e2e-32803134270-e26945cb-f88e-4e97-bbcf-4a17324bcff3
285 KB
sha256:1c6720aae2e634ad554e166ce406c8b388f9bef40faa5acb41085a3db0ffe340
coverage-e2e-32803134270-e33e7476-eba1-49e0-9e61-25c13bc68aca
328 KB
sha256:d5f2ad0fce7efb439673e8c0de207f0d921fca45beaf449c2f28cb1f109ab663
coverage-e2e-32803134270-e7c0458b-b06c-4aec-b21e-85610ea0594f
854 KB
sha256:2d4c46e4a9d1e3a32137b1af3c92b0332a2b6b124a6adaed5257b9a8c617e532
coverage-e2e-32803134270-f00b17bb-77c2-47fb-9395-6c7a92f0a07a
399 KB
sha256:a0ceb7c8f9612acc0709de8a279519acd1274f59881cb3fa8f23d36e780c05da
coverage-e2e-32803134270-f2748d06-e1fb-43da-b8fc-2260044a9c8a
802 KB
sha256:bb865a85bd5fd9f8cc42d9ff8deb892811b4f42949af87e413dc8aecbba03b0b
coverage-e2e-32803134270-f3020f98-664a-408a-a910-810ae156638e
285 KB
sha256:abb7c3d51f345d248be3a9155dcdebd94a68d50605a431dabb12c64884a66da2
coverage-e2e-32803134270-fd7162df-79d9-4faa-96ef-8818c7dc5d5b
286 KB
sha256:d408beee570eac7b11eb26b5ea45652e70f06b6a1ac8bda43fa948900f71b244
coverage-e2e-32803134270-fef5f531-59dc-4cb2-a025-350d12086d62
802 KB
sha256:7240ac4073705574836ff954f06480baf14adee55ecb19ad48498dd3e894d1d7
coverage-e2e-aggregated
163 KB
sha256:a82084314abb02ac841ffe636ee5682fda849f69d12d1873255dc19b2ba0db24
coverage-unit-test-32803134270-0dea4b91-d571-41e6-9c2d-69aa727b77d1
385 KB
sha256:1d57ca419b2cb31a5e4dfdf49c2d562df0be9e410a70e5dff49bc97a4925821f
coverage-unit-test-32803134270-c7be6dcf-8c58-4308-9c09-fbb486561092
945 KB
sha256:865e14ed86c246ceab33255286bf61aa18f07f0691d6e0ab86fbac94eebe73fe
coverage-unit-test-32803134270-d569b251-9a48-4f7a-a582-ff02449d3137
945 KB
sha256:7dc592876f83cf3092cd792ec6982bb91c8f8e48e5c6303e762a33ba34ba687c
coverage-unit-test-32803134270-ed727c30-50a9-44c0-8078-1fd9027f7f99
938 KB
sha256:2ee71f0185a9f88a99d181f372363e236feccea035ef0184ef44394f01bcbe2f
coverage-unit-test-aggregated
163 KB
sha256:c54127547359008290e696b833cbc7bb21aa0600dba34c61ef19efe4a3c2da17