Skip to content

Commit 9ccf3b0

Browse files
fix: increase /dev/shm for vLLM CPU test containers
vLLM 0.27.1's multiproc executor allocates its inter-process message queue in /dev/shm and now requires 160 MiB, but Docker's default /dev/shm is only 64 MiB. As a result EngineCore fails to start with "Insufficient space in /dev/shm" and the vLLM server never binds to its port, causing the inference/embedding readiness checks to time out. Pass --shm-size=2g to the test container so the engine has enough shared memory to start. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 503da0a commit 9ccf3b0

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

.github/actions/setup-vllm/action.yml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,9 +29,13 @@ runs:
2929
fi
3030
3131
# Start vllm container
32+
# --shm-size: vLLM's multiproc executor allocates its inter-process
33+
# message queue in /dev/shm; the Docker default of 64 MiB is too small
34+
# (v0.27.1 requires 160 MiB) and EngineCore fails to start without this.
3235
docker run -d \
3336
--name vllm-$VLLM_MODE \
3437
--net=host \
38+
--shm-size=2g \
3539
$VLLM_IMAGE \
3640
$VLLM_ARGS
3741

0 commit comments

Comments
 (0)