Skip to content

Commit 16a983e

Browse files
Update vLLM to pinned version 0.18.1 (#135)
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
1 parent 8fa1f5f commit 16a983e

1 file changed

Lines changed: 3 additions & 5 deletions

File tree

  • usage-cookbook/Nemotron-3-Super/SparkDeploymentGuide

usage-cookbook/Nemotron-3-Super/SparkDeploymentGuide/README.md

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Nemotron 3 Super — DGX Spark Deployment Guide
22

3-
DGX Spark ships a single Grace-Blackwell GPU with 128 GB of unified memory. This guide covers serving Nemotron 3 Super on a single DGX Spark using vLLM (nightly) and TensorRT-LLM.
3+
DGX Spark ships a single Grace-Blackwell GPU with 128 GB of unified memory. This guide covers serving Nemotron 3 Super on a single DGX Spark using vLLM and TensorRT-LLM.
44

55
## Architecture Refresher
66

@@ -29,11 +29,9 @@ wget https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4/raw/m
2929
### Image
3030

3131
```
32-
vllm/vllm-openai:cu130-nightly
32+
vllm/vllm-openai:v0.18.1-cu130
3333
```
3434

35-
MTP + NVFP4 on DGX Spark requires a vLLM nightly build (cu130). The pinned release `0.17.1` does not support this combination on a single-GPU Spark configuration.
36-
3735
### Serve Command
3836

3937
```bash
@@ -48,7 +46,7 @@ docker run --rm -it --gpus all \
4846
-v ~/.cache/huggingface:/root/.cache/huggingface \
4947
-v $(pwd)/super_v3_reasoning_parser.py:/app/super_v3_reasoning_parser.py \
5048
-p 8000:8000 \
51-
vllm/vllm-openai:cu130-nightly \
49+
vllm/vllm-openai:v0.18.1-cu130 \
5250
--model nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 \
5351
--served-model-name nemotron-3-super \
5452
--host 0.0.0.0 \

0 commit comments

Comments
 (0)