Commit 2bac207
loopyt
fix(mla): rename _forward_decode to forward_mqa for vllm 0.20.0
vllm 0.20.0 renamed the MLACommonImpl decode override from _forward_decode
to forward_mqa (same signature). MLAFLImpl still defined _forward_decode, so
its implementation was never dispatched and the abstract forward_mqa raised
NotImplementedError at decode. Rename to match the base class.1 parent 4b6c1b2 commit 2bac207
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
122 | | - | |
| 122 | + | |
123 | 123 | | |
124 | 124 | | |
125 | 125 | | |
| |||
0 commit comments