Commit 38e7dbc
authored
Support kunlunxin backend (#268)
### PR Category
Others
### PR Type
New Features
### Description
Based on vLLM 0.20.2 (empty), adapted for vllm-plugin-FL with support
for the Kunlunxin backend.The Qwen3.6-35B-A3B and Qwen3.6-27B models
have been verified, the test includes high-concurrency input of text and
images.
Test command:
export FLAGCX_PATH=/workspace/FlagCX
export USE_RESHAPE_AND_CACHE_FLASH=1
vllm serve /workspace/models/Qwen3.6-27B \
--served-model-name qwen3 \
--tensor-parallel-size 4 \
--max-model-len 16384\
--reasoning-parser qwen3 \
--block-size 128 \
--gpu-memory-utilization 0.8 \
--enforce-eager \
--port 8100
Verified results:
<img width="609" height="285" alt="image"
src="https://github.com/user-attachments/assets/be79815f-a7ce-45bd-a079-15f115d107b6"
/>
### Changes
Add Kunlunxin backend support.1 parent d599e5e commit 38e7dbc
26 files changed
Lines changed: 3682 additions & 53 deletions
File tree
- vllm_fl
- dispatch
- backends/vendor/kunlunxin
- impl
- fla
- fused_moe
- patches
- config
- ops
- fused_moe
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
97 | 105 | | |
98 | 106 | | |
| 107 | + | |
| 108 | + | |
99 | 109 | | |
100 | 110 | | |
101 | 111 | | |
| |||
167 | 177 | | |
168 | 178 | | |
169 | 179 | | |
170 | | - | |
171 | 180 | | |
172 | 181 | | |
173 | 182 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
Lines changed: 30 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
0 commit comments