Skip to content

Commit f894492

Browse files
Fix gems DeviceDetector api (#236)
### PR Category Core ### PR Type Bug Fixes ### Description Fix gems DeviceDetector api
1 parent 672dedc commit f894492

1 file changed

Lines changed: 6 additions & 1 deletion

File tree

vllm_fl/utils.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,12 @@
55
from typing import Optional, Tuple
66

77
import flag_gems
8-
from flag_gems.runtime.backend.device import DeviceDetector
8+
try:
9+
# FlagGems<=5.0.2: DeviceDetector lives in device.
10+
from flag_gems.runtime.backend.device import DeviceDetector
11+
except ImportError:
12+
# FlagGems>5.0.2: DeviceDetector lives in device_finder.
13+
from flag_gems.runtime.backend.device_finder import DeviceDetector
914
from flag_gems.runtime import backend
1015

1116
_OP_CONFIG: Optional[dict[str, str]] = None

0 commit comments

Comments
 (0)