Skip to content

Default to only applying QK norm over the head dimension#1367

Open
christianazinn wants to merge 1 commit intoEleutherAI:mainfrom
christianazinn:christian/qk_layernorm_fix
Open

Default to only applying QK norm over the head dimension#1367
christianazinn wants to merge 1 commit intoEleutherAI:mainfrom
christianazinn:christian/qk_layernorm_fix

Commits

Commits on Jan 6, 2026