Skip to content

Commit ac8d66b

Browse files
committed
add linear to blacklist to avoid problem in VL model
1 parent 32ca98e commit ac8d66b

1 file changed

Lines changed: 18 additions & 2 deletions

File tree

vllm_fl/dispatch/config/sunrise.yaml

Lines changed: 18 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -43,8 +43,8 @@ strict: false
4343
op_backends:
4444
# All operators: prioritize FlagGems (Triton), fallback to vendor, then reference
4545
attention_backend:
46-
- flagos
4746
- vendor:sunrise
47+
- flagos
4848
- reference
4949

5050
rms_norm:
@@ -58,14 +58,30 @@ op_backends:
5858
- reference
5959

6060
rotary_embedding:
61+
- vendor:sunrise
62+
- flagos
63+
- reference
64+
65+
topk_softmax:
66+
- flagos
67+
- vendor:sunrise
68+
- reference
69+
70+
moe_sum:
71+
- flagos
72+
- vendor:sunrise
73+
- reference
74+
75+
moe_align_block_size:
6176
- flagos
6277
- vendor:sunrise
6378
- reference
6479

6580
# FlagOS operator blacklist
6681
# Sunrise is CUDA-compatible, so most FlagGems ops should work
6782
# Blacklist only ops that are known to have issues
68-
flagos_blacklist: []
83+
flagos_blacklist:
84+
- linear
6985

7086
# OOT (Out-of-Tree) operator blacklist
7187
# These operators will NOT be registered as OOT replacements.

0 commit comments

Comments
 (0)