@@ -6,26 +6,26 @@ summary: >
66 Performance disclaimer: this model has not been performance-tuned; reported
77 timing and throughput metrics are sanity checks, not optimized performance
88 results. K-EXAONE 2.0 750B-A37B has public H100 recipes for pretraining,
9- full SFT, and PEFT in this Bridge revision. CPU conversion, clean-commit GPU
10- conversion reruns, training, export-after-SFT, long-context SFT, and
11- checkpoint resume remain unverified. Complete 750B GPU import and export artifacts have persisted,
12- the imported checkpoint reloaded successfully, and a full 59,396-tensor
13- audit is bitwise exact. A 2-GPU structural MoE/MTP proxy also completed three
9+ full SFT, and PEFT in this Bridge revision. CPU conversion, GPU export,
10+ training, export-after-SFT, long-context SFT, and checkpoint resume remain
11+ unverified. A complete 750B GPU import from a clean commit persisted and
12+ reloaded successfully, and a full 59,396-tensor audit is bitwise exact. A
13+ 2-GPU structural MoE/MTP proxy also completed three
1414 finite optimizer steps and saved checkpoints, but does not substitute for a
1515 full-model training item. A memory-bounded reference forward processed all
1616 78 Hugging Face decoder layers for a Korean prompt; Megatron matched its
1717 next token with 0.999993 cosine similarity. Complete-model deterministic
1818 inference generated and independently confirmed exactly 16 new tokens. The
19- implementation fixes are committed and clean-commit conversion reruns must
20- complete before their status promotion .
19+ implementation fixes are committed; GPU export remains unverified pending
20+ its own clean-commit rerun and exact audit .
2121verification_index :
2222 model_level :
2323 verified :
24+ - hf_to_megatron_gpu
2425 - manual_forward_pass
2526 - inference
2627 unverified :
2728 - hf_to_megatron_cpu
28- - hf_to_megatron_gpu
2929 - megatron_to_hf_cpu
3030 - megatron_to_hf_gpu
3131 training :
3737 architecture : ExaoneMoeForCausalLM
3838 min_transformers_version : " 5.9.0"
3939verification_environment :
40- base_container : nvcr.io/nvidia/nemo:26.06
41- bridge_commit : 68d7e875d3bcfad5cd0e7e7d18770cc7e5630034 # pragma: allowlist secret
40+ base_container : nvcr.io/nvidia/nemo:26.08
41+ bridge_commit : 766f7106e6502f71f799706a1dd874644eadb9ef # pragma: allowlist secret
4242
4343items :
4444 hf_to_megatron_cpu :
5353 dtypes, and values.
5454
5555 hf_to_megatron_gpu :
56- status : unverified
56+ status : verified
5757 precision : bf16
5858 command : >
5959 ./scripts/conversion/convert.sh import --executor slurm --device gpu
@@ -63,14 +63,13 @@ items:
6363 --megatron-path work/model-verification/k-exaone-2/imported-megatron
6464 --torch-dtype bfloat16 --tp 1 --pp 3 --ep 16 --etp 1
6565 --distributed-timeout-minutes 180 --low-memory-save
66- last_verified : null
66+ last_verified : 2026-08-24
6767 expected_result : >
6868 The pinned 59,396-tensor BF16 checkpoint imported and persisted
6969 iter_0000000 on 48 H100 GPUs, and that artifact subsequently reloaded
70- for a full GPU export. A distributed audit compared all 59,396 tensors
71- and 1,498,715,008,512 payload bytes with zero missing, unexpected,
72- shape, dtype, or value mismatches. This item remains unverified only
73- because its clean-commit import/reload rerun is still in progress.
70+ for a full distributed GPU re-export audit. The audit compared all
71+ 59,396 tensors and 1,498,715,010,176 payload bytes with zero missing,
72+ unexpected, duplicate, shape, dtype, or value mismatches.
7473
7574 megatron_to_hf_cpu :
7675 status : unverified
@@ -109,6 +108,7 @@ items:
109108 manual_forward_pass :
110109 status : verified
111110 precision : bf16
111+ bridge_commit : 68d7e875d3bcfad5cd0e7e7d18770cc7e5630034 # pragma: allowlist secret
112112 command : >
113113 uv run python -m torch.distributed.run --standalone --nproc_per_node=48
114114 examples/conversion/compare_hf_and_megatron/compare.py
0 commit comments