Commit 506e04e
committed
Only emit qk_norm_epsilon GQA attribute when q/k norm weights are present
The unconditional qk_norm_epsilon attribute broke plain GQA models (e.g.
phi-2): the current onnxruntime nightly does not recognize the attribute,
so model load failed with "Unrecognized attribute: qk_norm_epsilon for
operator GroupQueryAttention". It also failed the
test_plain_gqa_omits_qk_norm_epsilon_attribute unit test. Restore the
guard so the attribute is only added on the fused Q/K norm path.1 parent 7fc7837 commit 506e04e
1 file changed
Lines changed: 2 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2751 | 2751 | | |
2752 | 2752 | | |
2753 | 2753 | | |
2754 | | - | |
2755 | 2754 | | |
| 2755 | + | |
| 2756 | + | |
2756 | 2757 | | |
2757 | 2758 | | |
2758 | 2759 | | |
| |||
0 commit comments