Default to only applying QK norm over the head dimension#1367
Open
christianazinn wants to merge 1 commit intoEleutherAI:mainfrom
Open
Default to only applying QK norm over the head dimension#1367christianazinn wants to merge 1 commit intoEleutherAI:mainfrom
christianazinn wants to merge 1 commit intoEleutherAI:mainfrom