Skip to content

Reduce peak vram in moe.py by avoiding cached router indices - #464

Open
shedrachIkenna wants to merge 1 commit into
meta-llama:mainfrom
shedrachIkenna:patch-1
Open

Reduce peak vram in moe.py by avoiding cached router indices #464
shedrachIkenna wants to merge 1 commit into
meta-llama:mainfrom
shedrachIkenna:patch-1

Commits

Commits on Feb 25, 2026