Merge branch 'main' into codequality/setup-peft-parameter-statistics-… #20952
copy-pr-bot[bot]cicd-main.yml
on: push
pre-flight
/
pre-flight
18s
Matrix: cicd-container-build
Matrix: cicd-unit-tests-core
Matrix: cicd-functional-tests-l0
Matrix: cicd-functional-tests-l1
Matrix: cicd-functional-tests-l2
Matrix: cicd-functional-tests-flaky
Matrix: cicd-functional-tests-gb200-l0
Matrix: cicd-functional-tests-gb200-l1
Matrix: cicd-functional-tests-gb200-l2
Matrix: cicd-functional-tests-gb200-flaky
Coverage_Fake
Matrix: Coverage
Deployment protection rules
Reviewers, timers, and other rules protecting deployments in this run
| Event | Environments |
|---|---|
svcnvidia-nemo-ci
approved
|
test |
Annotations
63 warnings and 30 notices
|
cicd-container-build (aws, 766267172432.dkr.ecr.us-east-1.amazonaws.com, nemo-ci-aws-gpu-x2-ephem...
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/build-push-action@ca052bb54ab0790a636c9b5f226502c73d547a25, docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Launch_Unit_Tests_Diffusion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Diffusion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_0
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_0
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_2
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_1
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Launch_Unit_Tests_Core_1
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_decentralized_pg
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_decentralized_pg
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_llama_1b
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter_generate
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter_generate
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_converter_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_callbacks
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_callbacks
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_data
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_nemotron_omni
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_deepseek
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_megatron_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_megatron_fsdp
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_perf_config
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_qwen3
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_flux
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_models_flux
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_recipes_gemma4_vl
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_distributed_save
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_distributed_save
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_finetune
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_finetune
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_dspark
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_dspark
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_utils
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_tensor_inspect
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_tensor_inspect
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_local_checkpointing
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_local_checkpointing
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_megatron_mimo
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_megatron_mimo
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_resiliency
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_resiliency
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_pretrain
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_training_pretrain
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_wan_ckpt_conversion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
L0_Launch_wan_ckpt_conversion
Input 'app-id' has been deprecated with message: Use 'client-id' instead.
|
|
Coverage (e2e)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Coverage (unit-test)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Result
✅ Launch_Unit_Tests_Diffusion — PASSED
|
|
Result
✅ Launch_Unit_Tests_Core — PASSED
|
|
Result
✅ Launch_Unit_Tests_Core — PASSED
|
|
Result
✅ Launch_Unit_Tests_Core — PASSED
|
|
Result
✅ L0_Launch_recipes_deepseek — PASSED
|
|
Result
✅ L0_Launch_training_decentralized_pg — PASSED
|
|
Result
✅ L0_Launch_recipes_llama_1b — PASSED
|
|
Result
✅ L0_Launch_converter — PASSED
|
|
Result
✅ L0_Launch_converter_generate — PASSED
|
|
Result
✅ L0_Launch_converter_fsdp — PASSED
|
|
Result
✅ L0_Launch_training_callbacks — PASSED
|
|
Result
✅ L0_Launch_data — PASSED
|
|
Result
✅ L0_Launch_models_nemotron_omni — PASSED
|
|
Result
✅ L0_Launch_models_deepseek — PASSED
|
|
Result
✅ L0_Launch_megatron_fsdp — PASSED
|
|
Result
✅ L0_Launch_recipes_perf_config — PASSED
|
|
Result
✅ L0_Launch_models_qwen3 — PASSED
|
|
Result
✅ L0_Launch_models_gemma4_vl — PASSED
|
|
Result
✅ L0_Launch_models_flux — PASSED
|
|
Result
✅ L0_Launch_recipes_gemma4_vl — PASSED
|
|
Result
✅ L0_Launch_training_distributed_save — PASSED
|
|
Result
✅ L0_Launch_training_finetune — PASSED
|
|
Result
✅ L0_Launch_training_dspark — PASSED
|
|
Result
✅ L0_Launch_utils — PASSED
|
|
Result
✅ L0_Launch_training_tensor_inspect — PASSED
|
|
Result
✅ L0_Launch_training_local_checkpointing — PASSED
|
|
Result
✅ L0_Launch_training_megatron_mimo — PASSED
|
|
Result
✅ L0_Launch_training_resiliency — PASSED
|
|
Result
✅ L0_Launch_training_pretrain — PASSED
|
|
Result
✅ L0_Launch_wan_ckpt_conversion — PASSED
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-e2e-32784277571-00cddc08-8316-4ce8-b516-072809f0937b
|
802 KB |
sha256:858eb9e48d7777a4cd957d55a126f0678e774721c91aa4bee0621ce609d5cb6c
|
|
|
coverage-e2e-32784277571-0df8ee34-cb54-4bc3-b011-b0f446706a4d
|
378 KB |
sha256:d2bb14926d2cae16cd605ed296e4d3d1d0a64e82bb4982c1781b884cdafae434
|
|
|
coverage-e2e-32784277571-1ac1fe25-ad07-4d68-b4ca-e401cb3d5195
|
286 KB |
sha256:255dcd5ac9976a53400fbcdf0d9d692f7b67b2216313fb44a2b38195007e78cf
|
|
|
coverage-e2e-32784277571-1bca2097-fe4a-47d0-b959-55b72753c676
|
313 KB |
sha256:e160f291af6af40e40008785d150f669f9ef083cccf76fc50e936afa142666dd
|
|
|
coverage-e2e-32784277571-2f9ba522-b14c-413e-aedc-e1c95a9d349d
|
328 KB |
sha256:b25d421da8ead2b053d85e90e16df3cd9e914ceb4867d08cceabf6496ca60fa3
|
|
|
coverage-e2e-32784277571-3d470106-91bc-446b-826a-a5a52a51ca76
|
783 KB |
sha256:5b12cae1ce0db17f986739aea94b1b3b7f380cde8481a8538ec1dce117a99f5b
|
|
|
coverage-e2e-32784277571-542ca082-94ff-4ca6-9f82-16439ff1fba1
|
800 KB |
sha256:5d99835e4c65568768d40971110b1b0844966dff553b8e3ae061ed203005f30d
|
|
|
coverage-e2e-32784277571-56c9ccfd-a8f6-4da8-8ee2-7e3e1aa06b58
|
783 KB |
sha256:003aa51c137677107beece6487ad488cdb69d89bbcc8fe2513758aed084fc0ab
|
|
|
coverage-e2e-32784277571-6b5a4ee6-33f9-4560-a3ab-afdca18583bb
|
418 KB |
sha256:77888f5fbe1941cffab635b3329379c231453620c3025a430dd1164c90b25ea7
|
|
|
coverage-e2e-32784277571-76352a22-61aa-45b5-b296-00faf090c015
|
432 KB |
sha256:6aa7c3f5dcb705c036ade404064f9ebed0f04a6e4a755ce9bdad83745c28bf42
|
|
|
coverage-e2e-32784277571-794196d9-1494-4c78-8c3e-86d031235919
|
864 KB |
sha256:3ea2d67a5edfb761e73d2a2a9e4ba80735e772645a0e6089cfd9a0864f0a2a92
|
|
|
coverage-e2e-32784277571-93b44224-bcff-4450-a341-f55083b50734
|
386 KB |
sha256:069920f206649f7013dc2ddbf0b9f9b1a9fd67a711acf86c8a31cd2cbdb56c6c
|
|
|
coverage-e2e-32784277571-946e5168-d8ff-442c-a2ca-828d62f88d4e
|
328 KB |
sha256:cd5fce9285278a866da89bc0e052418152a9309b5764a00b1ebbedaa93c1dc63
|
|
|
coverage-e2e-32784277571-9c8cdd77-067d-43f7-9439-01ce211859d3
|
358 KB |
sha256:bed61d7c2f945c4d6414b017f77c184ff9d21f77e921c16d0d6636f6bc4639e7
|
|
|
coverage-e2e-32784277571-a229be96-16c7-4ff8-85a6-95e0436130d5
|
559 KB |
sha256:bf66fe1a23f40660678f85d78fa6bfd40631c93fe6299bd8cfeeeaab1fddef57
|
|
|
coverage-e2e-32784277571-b15c01a9-877d-44b9-bb19-7147c20b5255
|
1.29 KB |
sha256:e6e16426f594d8e19cfc8c6051cba9452b10df522ee9e7256822b33b9cec0963
|
|
|
coverage-e2e-32784277571-b2596458-c897-4632-b2e6-929f88a9239e
|
321 KB |
sha256:0515fa6f5defc822b3a56301675154a7905bcd11290704d6bb2dd902b85e41d6
|
|
|
coverage-e2e-32784277571-b399a6e8-8cc8-453e-8f37-42603ab0e4f8
|
358 KB |
sha256:9ceef3447f6c1c5a299d8c7845b5add9aee1058e3d3eba625cacd86d1100156c
|
|
|
coverage-e2e-32784277571-bf76cae5-2638-44bc-9494-3afba9d3527f
|
802 KB |
sha256:5ab4a0de9eaddd6d5049376b3bff4016a156f1efba4b9c14ea8b63a9bfa47a26
|
|
|
coverage-e2e-32784277571-c1ced4ad-a76e-4d7e-b455-3ede53972881
|
501 KB |
sha256:845a4289a9836d6aea5f5d8739edcf902a6f335a1268148a92a82e53aeb4c823
|
|
|
coverage-e2e-32784277571-ca468b44-7f87-464f-8c49-e0e89f55bb77
|
286 KB |
sha256:ab31bd8dd730b183efb8c8f6333e0a444c2ef66c77d1407233fda0964ced4383
|
|
|
coverage-e2e-32784277571-d538e85f-191b-4e89-b69d-86dd259baa23
|
357 KB |
sha256:5f5efe8d082f49760f2deffdf27a8e09246371de5f1d1e8c78dcd925c4bc6ea3
|
|
|
coverage-e2e-32784277571-e0fe24e5-7c3c-4588-85df-3fcd5cb8d402
|
388 KB |
sha256:c331a4767813ccb3dadd13612bf9dfa96e997b4d080035a285247b69795c6d61
|
|
|
coverage-e2e-32784277571-e22e6783-dca7-475e-8f81-70c4ec08116a
|
857 KB |
sha256:43b1374ccfce4f17f61ba6293f12d4ff889cf0b93b955f3213927102397f6d7e
|
|
|
coverage-e2e-32784277571-f16fa5f0-cda2-448c-bd83-7a1ced2794ed
|
399 KB |
sha256:e0f3d19909a19025f90b0a3652aa0c3d35dc12a73fcfe884cdc525c5fa330e86
|
|
|
coverage-e2e-32784277571-f48d5672-8a5c-48b8-adce-3bf26b41eb47
|
784 KB |
sha256:d64beb14b680edeff9c0e68554bdf2b4dd60fdb50aaad4b75166dbbf037eb55b
|
|
|
coverage-e2e-aggregated
|
154 KB |
sha256:a0e97e6dad99e408243969cffa9bccf9ed698d0a4c47f24b8602d083c5b6ce2a
|
|
|
coverage-unit-test-32784277571-291d9d88-5f03-4963-9906-49879a27dd49
|
945 KB |
sha256:c4435ecf28c312cac4f673d79b1d039241678e17ff41064ef94ea1dac4528950
|
|
|
coverage-unit-test-32784277571-5d612093-37ca-4230-9969-1665c371267e
|
944 KB |
sha256:0b2ed5a07c9ae77860a7a53d5d3ab7e0d0a33dc33559ea336b12de5afb0e3dcd
|
|
|
coverage-unit-test-32784277571-81214f3a-e3f5-479b-8048-84bf3add08ab
|
385 KB |
sha256:cbe2fbd3708538ca8e015c2ff89d5d6d634057c4c3b654f11897083f3c753997
|
|
|
coverage-unit-test-32784277571-d7a554ee-b92d-42fe-af11-abc7215f9093
|
938 KB |
sha256:b35b74f8be18b90724a26c9b25d218930532cee15e83945c3fab987c67077299
|
|
|
coverage-unit-test-aggregated
|
163 KB |
sha256:110442bb1e352e928f7e5ea81e23ed21ac3a70a9e44af4116651d88d0d0e2c62
|
|