Commit dbfe3be
Fix is_monolithic missing when setting VLLM_FL_PREFER_ENABLED=0 (#252)
### PR Category
Core
### PR Type
Bug Fixes
### Description
fix is_monolithic missing when setting VLLM_FL_PREFER_ENABLED=0
```
Root cause chain:
is_out_of_tree() _ True (PlatformFL)
_
select_unquantized_moe_backend() returns (OOT, None)
_
experts_cls = None
_
code calls experts_cls.is_monolithic _ AttributeError: NoneType has no attribute 'is_monolithic'
The upstream function has this logic:
if current_platform.is_out_of_tree():
return UnquantizedMoeBackend.OOT, None # _ expects OOT PluggableLayer to handle it
When FusedMoEFL is registered, vLLM never reaches this code path (it uses FusedMoEFL's own method). But when FusedMoEFL is not registered (disabled/blacklisted), vLLM falls through to the
built-in FusedMoE, which calls select_unquantized_moe_backend(). Since PlatformFL still reports is_out_of_tree() _ True, it returns (OOT, None) and blows up.
```
---------
Co-authored-by: ceci3 <ceci3@users.noreply.github.com>1 parent 9f2d78f commit dbfe3be
2 files changed
Lines changed: 34 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
128 | 128 | | |
129 | 129 | | |
130 | 130 | | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
131 | 134 | | |
132 | 135 | | |
133 | 136 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
32 | 52 | | |
33 | 53 | | |
34 | 54 | | |
| |||
40 | 60 | | |
41 | 61 | | |
42 | 62 | | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
43 | 67 | | |
44 | 68 | | |
45 | 69 | | |
46 | 70 | | |
47 | 71 | | |
| 72 | + | |
| 73 | + | |
48 | 74 | | |
49 | 75 | | |
50 | 76 | | |
| |||
62 | 88 | | |
63 | 89 | | |
64 | 90 | | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
65 | 96 | | |
66 | 97 | | |
67 | 98 | | |
| |||
0 commit comments