Skip to content

Commit d493c35

Browse files
authored
chore: upgrade vLLM to 0.19.0 (#325)
## Summary by CodeRabbit * **Chores** * Upgraded Docker container base image to a newer version, which may include performance improvements and bug fixes from the upstream project. * Updated the model download mechanism for improved compatibility and efficiency. Approved-by: skamenan7 Approved-by: cdoern
2 parents 13c56d1 + 22d7980 commit d493c35

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

vllm/Containerfile

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
#
33
# Reference: https://hub.docker.com/r/vllm/vllm-openai-cpu
44

5-
FROM vllm/vllm-openai-cpu:v0.18.1
5+
FROM vllm/vllm-openai-cpu:v0.19.0
66

77
RUN pip install "huggingface-hub[cli]"
88

@@ -27,9 +27,9 @@ RUN --mount=type=secret,id=hf_token \
2727
mkdir -p "${model_path}" && \
2828
if [ -f /run/secrets/hf_token ]; then \
2929
HF_TOKEN=$(cat /run/secrets/hf_token) && \
30-
huggingface-cli download "${model}" --local-dir "${model_path}" --token "${HF_TOKEN}"; \
30+
hf download "${model}" --local-dir "${model_path}" --token "${HF_TOKEN}"; \
3131
else \
32-
huggingface-cli download "${model}" --local-dir "${model_path}"; \
32+
hf download "${model}" --local-dir "${model_path}"; \
3333
fi && \
3434
rm -rf /root/.cache/huggingface "${model_path}/original"; \
3535
done

0 commit comments

Comments
 (0)