Skip to content

Commit d0f7f30

Browse files
committed
fix(musa): stabilize network-backed inference tests
1 parent ad99d07 commit d0f7f30

3 files changed

Lines changed: 6 additions & 0 deletions

File tree

tests/functional_tests/inference/qwen3/conf/inference/4b_tp2_musa.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,9 @@ llm:
1919
tensor_parallel_size: 2
2020
pipeline_parallel_size: 1
2121
gpu_memory_utilization: 0.5
22+
# KS3-backed checkpoints must be read sequentially. Lazy mmap loading can
23+
# trigger slow random reads and native worker crashes on MUSA.
24+
safetensors_load_strategy: eager
2225
max_model_len: 1024
2326
seed: 1234
2427
enforce_eager: true

tests/functional_tests/serve/qwen2_5/conf/0.5b_musa.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,7 @@ experiment:
3131
FS_PLATFORM: musa
3232
TORCHDYNAMO_DISABLE: 1
3333
TORCH_COMPILE_DISABLE: 1
34+
USE_FLAGGEMS: "false"
3435
VLLM_WORKER_MULTIPROC_METHOD: spawn
3536
MUSA_VISIBLE_DEVICES: "0"
3637
MTHREADS_VISIBLE_DEVICES: all

tests/functional_tests/serve/qwen2_5/conf/serve/0.5b_musa.yaml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,8 @@
1919
tensor_parallel_size: 1
2020
pipeline_parallel_size: 1
2121
gpu_memory_utilization: 0.5
22+
# Avoid lazy mmap reads from the network-backed model volume.
23+
safetensors_load_strategy: eager
2224
max_model_len: 1024
2325
max_num_seqs: 16
2426
enforce_eager: true

0 commit comments

Comments
 (0)