Commit 1a0aca1
committed
feat(cambricon): blacklist flag_gems
Add vllm_fl/dispatch/config/cambricon.yaml so the `empty` operator
blacklist is applied automatically on Cambricon MLU, instead of
requiring the VLLM_FL_FLAGOS_BLACKLIST env var at launch.
flag_gems `empty` derives its Triton launch grid from the element
count (e.g. 607744 for the Qwen3 vocab embedding), which exceeds the
MLU Triton grid limit of 65535 and raises OutOfResources. The config
falls the op back to torch_mlu.
The file is named `cambricon.yaml` to match current_platform.vendor_name
("cambricon"), which is how get_config_path() resolves the platform
config (Priority 3). Verified E2E on MLU590: serve reaches startup
complete and inference returns coherent output with no env var set.
This PR was written in part with the assistance of generative AI.empty via built-in config1 parent 7f6f35e commit 1a0aca1
1 file changed
Lines changed: 20 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
0 commit comments