Skip to content

Commit 7f6f35e

Browse files
committed
feat(cambricon): enable MLU590 (device map + graph class)
Add the two touchpoints needed to bring up vllm-plugin-FL on Cambricon MLU (torch_mlu), verified E2E with Qwen3-8B on MLU590: - VENDOR_DEVICE_MAP: register cambricon -> mlu, so the vendor-device lookup no longer raises ValueError for cambricon. - Graph: select torch.mlu.MLUGraph for device_type == "mlu", so graph capture no longer raises NotImplementedError("not support graph"). No dedicated cambricon dispatch backend is required; ops route through flag_gems (Triton) generically. This is minimal enablement only. This PR was written in part with the assistance of generative AI.
1 parent f4ebc25 commit 7f6f35e

2 files changed

Lines changed: 4 additions & 0 deletions

File tree

vllm_fl/compilation/graph.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,8 @@ class Graph:
5151
graph = torch.ptpu.PTPUGraph
5252
elif current_platform.device_type == "gcu":
5353
graph = torch.gcu.GCUGraph
54+
elif current_platform.device_type == "mlu":
55+
graph = torch.mlu.MLUGraph
5456
elif current_platform.device_type == "txda":
5557
graph = None
5658
else:

vllm_fl/utils.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,8 @@
5151
"enflame": {"device_type": "gcu", "device_name": "gcu"},
5252
# Registered backend: vendor/txda
5353
"tsingmicro": {"device_type": "txda", "device_name": "txda"},
54+
# Cambricon MLU (torch_mlu); ops dispatched via flag_gems
55+
"cambricon": {"device_type": "mlu", "device_name": "mlu"},
5456
}
5557

5658

0 commit comments

Comments
 (0)