Skip to content

Commit 9549659

Browse files
committed
docs(model-card): verify K-EXAONE-2 GPU import
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
1 parent 125695a commit 9549659

1 file changed

Lines changed: 16 additions & 16 deletions

File tree

  • examples/model_verification_cards/k-exaone-2

examples/model_verification_cards/k-exaone-2/card.yaml

Lines changed: 16 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -6,26 +6,26 @@ summary: >
66
Performance disclaimer: this model has not been performance-tuned; reported
77
timing and throughput metrics are sanity checks, not optimized performance
88
results. K-EXAONE 2.0 750B-A37B has public H100 recipes for pretraining,
9-
full SFT, and PEFT in this Bridge revision. CPU conversion, clean-commit GPU
10-
conversion reruns, training, export-after-SFT, long-context SFT, and
11-
checkpoint resume remain unverified. Complete 750B GPU import and export artifacts have persisted,
12-
the imported checkpoint reloaded successfully, and a full 59,396-tensor
13-
audit is bitwise exact. A 2-GPU structural MoE/MTP proxy also completed three
9+
full SFT, and PEFT in this Bridge revision. CPU conversion, GPU export,
10+
training, export-after-SFT, long-context SFT, and checkpoint resume remain
11+
unverified. A complete 750B GPU import from a clean commit persisted and
12+
reloaded successfully, and a full 59,396-tensor audit is bitwise exact. A
13+
2-GPU structural MoE/MTP proxy also completed three
1414
finite optimizer steps and saved checkpoints, but does not substitute for a
1515
full-model training item. A memory-bounded reference forward processed all
1616
78 Hugging Face decoder layers for a Korean prompt; Megatron matched its
1717
next token with 0.999993 cosine similarity. Complete-model deterministic
1818
inference generated and independently confirmed exactly 16 new tokens. The
19-
implementation fixes are committed and clean-commit conversion reruns must
20-
complete before their status promotion.
19+
implementation fixes are committed; GPU export remains unverified pending
20+
its own clean-commit rerun and exact audit.
2121
verification_index:
2222
model_level:
2323
verified:
24+
- hf_to_megatron_gpu
2425
- manual_forward_pass
2526
- inference
2627
unverified:
2728
- hf_to_megatron_cpu
28-
- hf_to_megatron_gpu
2929
- megatron_to_hf_cpu
3030
- megatron_to_hf_gpu
3131
training:
@@ -37,8 +37,8 @@ model:
3737
architecture: ExaoneMoeForCausalLM
3838
min_transformers_version: "5.9.0"
3939
verification_environment:
40-
base_container: nvcr.io/nvidia/nemo:26.06
41-
bridge_commit: 68d7e875d3bcfad5cd0e7e7d18770cc7e5630034 # pragma: allowlist secret
40+
base_container: nvcr.io/nvidia/nemo:26.08
41+
bridge_commit: 766f7106e6502f71f799706a1dd874644eadb9ef # pragma: allowlist secret
4242

4343
items:
4444
hf_to_megatron_cpu:
@@ -53,7 +53,7 @@ items:
5353
dtypes, and values.
5454
5555
hf_to_megatron_gpu:
56-
status: unverified
56+
status: verified
5757
precision: bf16
5858
command: >
5959
./scripts/conversion/convert.sh import --executor slurm --device gpu
@@ -63,14 +63,13 @@ items:
6363
--megatron-path work/model-verification/k-exaone-2/imported-megatron
6464
--torch-dtype bfloat16 --tp 1 --pp 3 --ep 16 --etp 1
6565
--distributed-timeout-minutes 180 --low-memory-save
66-
last_verified: null
66+
last_verified: 2026-08-24
6767
expected_result: >
6868
The pinned 59,396-tensor BF16 checkpoint imported and persisted
6969
iter_0000000 on 48 H100 GPUs, and that artifact subsequently reloaded
70-
for a full GPU export. A distributed audit compared all 59,396 tensors
71-
and 1,498,715,008,512 payload bytes with zero missing, unexpected,
72-
shape, dtype, or value mismatches. This item remains unverified only
73-
because its clean-commit import/reload rerun is still in progress.
70+
for a full distributed GPU re-export audit. The audit compared all
71+
59,396 tensors and 1,498,715,010,176 payload bytes with zero missing,
72+
unexpected, duplicate, shape, dtype, or value mismatches.
7473
7574
megatron_to_hf_cpu:
7675
status: unverified
@@ -109,6 +108,7 @@ items:
109108
manual_forward_pass:
110109
status: verified
111110
precision: bf16
111+
bridge_commit: 68d7e875d3bcfad5cd0e7e7d18770cc7e5630034 # pragma: allowlist secret
112112
command: >
113113
uv run python -m torch.distributed.run --standalone --nproc_per_node=48
114114
examples/conversion/compare_hf_and_megatron/compare.py

0 commit comments

Comments
 (0)