dynamo/docs/reference/release-artifacts.md at main · bedeks/dynamo

title	Release Artifacts

This document provides a comprehensive inventory of all Dynamo release artifacts including container images, Python wheels, Helm charts, and Rust crates.

See also: Support Matrix for hardware and platform compatibility | Feature Matrix for backend feature support

Release history in this document begins at v0.6.0.

Current Release: Dynamo v1.1.0

GitHub Release: v1.1.0
Docs: v1.1.0
NGC Collection: ai-dynamo

Experimental: v1.2.0-deepseek-v4-dev.2 (DeepSeek-V4-Flash / V4-Pro on Blackwell, vLLM + SGLang containers only) is available as an experimental preview. Dev releases ship a subset of artifacts -- see Pre-Release Artifacts for the exact images, wheels, and Helm charts published per version.

Container Images

Image:Tag	Description	Backend	CUDA	Arch	NGC	Notes
`vllm-runtime:1.1.0`	Runtime container for vLLM backend	vLLM `v0.19.0`	`v12.9`	AMD64/ARM64	link
`vllm-runtime:1.1.0-cuda13`	Runtime container for vLLM backend (CUDA 13)	vLLM `v0.19.0`	`v13.0`	AMD64/ARM64*	link
`vllm-runtime:1.1.0-efa-amd64`	Runtime container for vLLM with AWS EFA	vLLM `v0.19.0`	`v12.9`	AMD64	link	Experimental
`sglang-runtime:1.1.0`	Runtime container for SGLang backend	SGLang `v0.5.10.post1`	`v12.9`	AMD64/ARM64	link
`sglang-runtime:1.1.0-cuda13`	Runtime container for SGLang backend (CUDA 13)	SGLang `v0.5.10.post1`	`v13.0`	AMD64/ARM64*	link
`tensorrtllm-runtime:1.1.0`	Runtime container for TensorRT-LLM backend	TRT-LLM `v1.3.0rc11`	`v13.1`	AMD64/ARM64	link
`tensorrtllm-runtime:1.1.0-efa-amd64`	Runtime container for TensorRT-LLM with AWS EFA	TRT-LLM `v1.3.0rc11`	`v13.1`	AMD64	link	Experimental
`dynamo-frontend:1.1.0`	API gateway with Endpoint Prediction Protocol (EPP)	—	—	AMD64/ARM64	link
`kubernetes-operator:1.1.0`	Kubernetes operator for Dynamo deployments	—	—	AMD64/ARM64	link
`snapshot-agent:1.1.0`	Snapshot agent for fast GPU worker recovery via CRIU	—	—	AMD64/ARM64	link	Preview

* Multimodal inference on CUDA 13 images: works on AMD64 for all backends; works on ARM64 only for TensorRT-LLM (vllm-runtime:*-cuda13 and sglang-runtime:*-cuda13 do not support multimodality on ARM64).

Python Wheels

We recommend using the TensorRT-LLM NGC container instead of the ai-dynamo[trtllm] wheel. See the NGC container collection for supported images.

Package	Description	Python	Platform	PyPI
`ai-dynamo==1.1.0`	Main package with backend integrations (vLLM, SGLang, TRT-LLM)	`3.10`–`3.12`	Linux (glibc `v2.28+`)	link
`ai-dynamo-runtime==1.1.0`	Core Python bindings for Dynamo runtime	`3.10`–`3.12`	Linux (glibc `v2.28+`)	link
`kvbm==1.1.0`	KV Block Manager for disaggregated KV cache	`3.12`	Linux (glibc `v2.28+`)	link

Helm Charts

Chart	Description	NGC
`dynamo-platform-1.1.0`	Platform services (etcd, NATS) and Dynamo Operator for Dynamo cluster	link
`snapshot-1.1.0`	Snapshot DaemonSet for fast GPU worker recovery	link

Note

The dynamo-crds Helm chart is deprecated as of v1.0.0; CRDs are now managed by the Dynamo Operator. The dynamo-graph Helm chart is deprecated as of v0.9.0.

Rust Crates

Crate	Description	MSRV (Rust)	crates.io
`dynamo-runtime@1.1.0`	Core distributed runtime library	`v1.82`	link
`dynamo-llm@1.1.0`	LLM inference engine	`v1.82`	link
`dynamo-protocols@1.1.0`	Async OpenAI-compatible API client	`v1.82`	link
`dynamo-parsers@1.1.0`	Protocol parsers (SSE, JSON streaming)	`v1.82`	link
`dynamo-memory@1.1.0`	Memory management utilities	`v1.82`	link
`dynamo-config@1.1.0`	Configuration management	`v1.82`	link
`dynamo-tokens@1.1.0`	Tokenizer bindings for LLM inference	`v1.82`	link
`dynamo-mocker@1.1.0`	Inference engine simulator for benchmarking	`v1.82`	link
`dynamo-kv-router@1.1.0`	KV-aware request routing library	`v1.82`	link

Quick Install Commands

Container Images (NGC)

Tip

For detailed run instructions, see the backend-specific guides: vLLM | SGLang | TensorRT-LLM

# Runtime containers
docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:1.1.0
docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:1.1.0
docker pull nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:1.1.0

# CUDA 13 variants
docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:1.1.0-cuda13
docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:1.1.0-cuda13

# EFA variants (AWS, AMD64 only, experimental)
docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:1.1.0-efa-amd64
docker pull nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:1.1.0-efa-amd64

# Infrastructure containers
docker pull nvcr.io/nvidia/ai-dynamo/dynamo-frontend:1.1.0
docker pull nvcr.io/nvidia/ai-dynamo/kubernetes-operator:1.1.0
docker pull nvcr.io/nvidia/ai-dynamo/snapshot-agent:1.1.0

Python Wheels (PyPI)

Tip

For detailed installation instructions, see the Local Quick Start in the README.

# Install Dynamo with a specific backend (Recommended)
uv pip install "ai-dynamo[vllm]==1.1.0"
uv pip install --prerelease=allow "ai-dynamo[sglang]==1.1.0"
# TensorRT-LLM requires the NVIDIA PyPI index and pip
pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==1.1.0"

# Install Dynamo core only
uv pip install ai-dynamo==1.1.0

# Install standalone KVBM (Python 3.12 only)
uv pip install kvbm==1.1.0

Helm Charts (NGC)

Tip

For Kubernetes deployment instructions, see the Kubernetes Installation Guide.

helm install dynamo-platform oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform --version 1.1.0
helm install snapshot oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/snapshot --version 1.1.0

Rust Crates (crates.io)

Tip

For API documentation, see each crate on docs.rs. To build Dynamo from source, see Building from Source.

cargo add dynamo-runtime@1.1.0
cargo add dynamo-llm@1.1.0
cargo add dynamo-protocols@1.1.0
cargo add dynamo-parsers@1.1.0
cargo add dynamo-memory@1.1.0
cargo add dynamo-config@1.1.0
cargo add dynamo-tokens@1.1.0
cargo add dynamo-mocker@1.1.0
cargo add dynamo-kv-router@1.1.0

CUDA and Driver Requirements: For detailed CUDA toolkit versions and minimum driver requirements for each container image, see the Support Matrix.

Known Issues

For a complete list of known issues, refer to the release notes for each version:

Known Artifact Issues

Version	Artifact	Issue	Status
v0.9.0	`dynamo-platform-0.9.0`	Helm chart sets operator image to `0.7.1` instead of `0.9.0`.	Fixed in v0.9.0.post1
v0.8.1	`vllm-runtime:0.8.1-cuda13`	Container fails to launch.	Known issue
v0.8.1	`sglang-runtime:0.8.1-cuda13`, `vllm-runtime:0.8.1-cuda13`	Multimodality not expected to work on ARM64. Works on AMD64.	Known limitation
v0.8.0	`sglang-runtime:0.8.0-cuda13`	CuDNN installation issue caused PyTorch `v2.9.1` compatibility problems with `nn.Conv3d`, resulting in performance degradation and excessive memory usage in multimodal workloads.	Fixed in v0.8.1 (#5461)

Release History

v1.2.0-deepseek-v4-dev.2 (experimental, partial): DeepSeek-V4-Flash and V4-Pro on Blackwell. Ships vllm-runtime:1.2.0-deepseek-v4-cuda13-dev.2 (vLLM v0.20.0) plus sglang-runtime:1.2.0-deepseek-v4-{cuda12,cuda13}-dev.2 built on upstream lmsysorg/sglang:deepseek-v4-blackwell. No TensorRT-LLM container, no other component containers, no Helm charts, no wheels published. Snapshot dev build for early-access V4 support; not QA-gated.
v1.1.0: First post-v1.0.0 release. SGLang v0.5.10.post1 (NIXL v1.0.1, from upstream lmsysorg/sglang image), TRT-LLM v1.3.0rc11 (NIXL v0.10.1), vLLM v0.19.0 (NIXL v0.10.1). Resilient standalone KV indexer with recovery, Anthropic /v1/messages production-grade, SGLang multimodal disaggregated serving with embedding transfer / embedding cache / device-aware EPD routing, Mocker as performance-modeling and offline-replay engine, Planner FPM consolidation. See Release Notes for breaking changes.
v1.1.0-dev.3 (experimental, partial): Preview release on release/1.1.0-dev.3. Ships only tensorrtllm-runtime:1.1.0-dev.3 (TRT-LLM v1.3.0rc11) plus ai-dynamo and ai-dynamo-runtime wheels. No vLLM/SGLang containers, no other component containers, no Helm charts published. Not recommended for production use.
v1.1.0-dev.2 (experimental, partial): Preview release. Ships sglang-runtime:1.1.0-dev.2 (SGLang v0.5.9) and tensorrtllm-runtime:1.1.0-dev.2 (TRT-LLM v1.3.0rc9) plus ai-dynamo, ai-dynamo-runtime, and kvbm wheels. No vLLM container, no other component containers, no Helm charts published. Not recommended for production use.
v1.1.0-dev.1 (experimental): Preview release. SGLang v0.5.9, TRT-LLM v1.3.0rc5.post1, vLLM v0.17.1, NIXL v0.10.1. Not recommended for production use.
v1.0.2: Patch release. Same backend versions as v1.0.0: SGLang v0.5.9, TRT-LLM v1.3.0rc5.post1, vLLM v0.16.0, NIXL v0.10.1.
v1.0.1: Patch release. Same backend versions as v1.0.0: SGLang v0.5.9, TRT-LLM v1.3.0rc5.post1, vLLM v0.16.0, NIXL v0.10.1.
v1.0.0: First major release. SGLang v0.5.9, TRT-LLM v1.3.0rc5.post1 (CUDA 13.1), vLLM v0.16.0, NIXL v0.10.1. New snapshot-agent container and snapshot Helm chart (Preview). New EFA container variants for vLLM and TRT-LLM (Experimental, AMD64 only). New dynamo-mocker and dynamo-kv-router Rust crates. Deprecated dynamo-crds Helm chart (CRDs now managed by the Operator). v1alpha1 CRDs deprecated.
v0.9.1: Updated TRT-LLM to v1.3.0rc3. All other backend versions unchanged from v0.9.0.
v0.9.0.post1: Fixed dynamo-platform Helm chart operator image tag (Helm chart only, NGC)
v0.9.0: Updated vLLM to v0.14.1, SGLang to v0.5.8, TRT-LLM to v1.3.0rc1, NIXL to v0.9.0. New dynamo-tokens Rust crate. Deprecated dynamo-graph Helm chart.
v0.8.1.post1/.post2/.post3 Patches: Experimental patch releases updating TRT-LLM only (PyPI wheels and TRT-LLM container). No other artifacts changed.
Standalone Frontend Container: dynamo-frontend added in v0.8.0
EFA Runtimes: Experimental AWS EFA variants for vLLM and TRT-LLM (AMD64 only) in v1.0.0
CUDA 13 Runtimes: Experimental CUDA 13 runtime for SGLang and vLLM in v0.8.0
New Rust Crates: dynamo-memory and dynamo-config added in v0.8.0

GitHub Releases

Version	Release Date	GitHub	Docs	Notes
`v1.2.0-deepseek-v4-dev.2`	May 1, 2026	Tag	—	Experimental (DeepSeek-V4-Flash / V4-Pro Blackwell preview; vLLM + SGLang containers only)
`v1.1.0`	May 1, 2026	Release	Docs
`v1.1.0-dev.3`	Apr 18, 2026	Tag	—	Experimental (partial: trtllm container + ai-dynamo wheels only)
`v1.1.0-dev.2`	Apr 9, 2026	Tag	—	Experimental (partial: sglang + trtllm containers, ai-dynamo wheels)
`v1.1.0-dev.1`	Mar 17, 2026	Tag	—	Experimental
`v1.0.2`	Apr 22, 2026	Release	Docs
`v1.0.1`	Mar 16, 2026	Release	Docs
`v1.0.0`	Mar 12, 2026	Release	Docs
`v0.9.1`	Mar 4, 2026	Release	Docs
`v0.9.0`	Feb 11, 2026	Release	Archived docs unavailable
`v0.8.1`	Jan 23, 2026	Release	Archived docs unavailable
`v0.8.0`	Jan 15, 2026	Release	Archived docs unavailable
`v0.7.1`	Dec 15, 2025	Release	Archived docs unavailable
`v0.7.0`	Nov 26, 2025	Release	Archived docs unavailable
`v0.6.1`	Nov 6, 2025	Release	—
`v0.6.0`	Oct 28, 2025	Release	—

Container Images

NGC Collection: ai-dynamo

To access a specific version, append ?version=TAG to the container URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/{container}?version={tag}

vllm-runtime

Image:Tag	vLLM	Arch	CUDA	Notes
`vllm-runtime:1.1.0`	`v0.19.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:1.1.0-cuda13`	`v0.19.0`	AMD64/ARM64*	`v13.0`
`vllm-runtime:1.1.0-efa-amd64`	`v0.19.0`	AMD64	`v12.9`	Experimental
`vllm-runtime:1.0.2`	`v0.16.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:1.0.2-cuda13`	`v0.16.0`	AMD64/ARM64*	`v13.0`
`vllm-runtime:1.0.2-efa-amd64`	`v0.16.0`	AMD64	`v12.9`	Experimental
`vllm-runtime:1.0.1`	`v0.16.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:1.0.1-cuda13`	`v0.16.0`	AMD64/ARM64*	`v13.0`
`vllm-runtime:1.0.1-efa-amd64`	`v0.16.0`	AMD64	`v12.9`	Experimental
`vllm-runtime:1.0.0`	`v0.16.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:1.0.0-cuda13`	`v0.16.0`	AMD64/ARM64*	`v13.0`
`vllm-runtime:1.0.0-efa-amd64`	`v0.16.0`	AMD64	`v12.9`	Experimental
`vllm-runtime:0.9.1`	`v0.14.1`	AMD64/ARM64	`v12.9`
`vllm-runtime:0.9.1-cuda13`	`v0.14.1`	AMD64/ARM64*	`v13.0`	Experimental
`vllm-runtime:0.9.0`	`v0.14.1`	AMD64/ARM64	`v12.9`
`vllm-runtime:0.9.0-cuda13`	`v0.14.1`	AMD64/ARM64*	`v13.0`	Experimental
`vllm-runtime:0.8.1`	`v0.12.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:0.8.0`	`v0.12.0`	AMD64/ARM64	`v12.9`
`vllm-runtime:0.8.0-cuda13`	`v0.12.0`	AMD64/ARM64	`v13.0`	Experimental
`vllm-runtime:0.7.0.post2`	`v0.11.2`	AMD64/ARM64	`v12.8`	Patch
`vllm-runtime:0.7.1`	`v0.11.0`	AMD64/ARM64	`v12.8`
`vllm-runtime:0.7.0.post1`	`v0.11.0`	AMD64/ARM64	`v12.8`	Patch
`vllm-runtime:0.7.0`	`v0.11.0`	AMD64/ARM64	`v12.8`
`vllm-runtime:0.6.1.post1`	`v0.11.0`	AMD64/ARM64	`v12.8`	Patch
`vllm-runtime:0.6.1`	`v0.11.0`	AMD64/ARM64	`v12.8`
`vllm-runtime:0.6.0`	`v0.11.0`	AMD64	`v12.8`

sglang-runtime

Image:Tag	SGLang	Arch	CUDA	Notes
`sglang-runtime:1.1.0`	`v0.5.10.post1`	AMD64/ARM64	`v12.9`
`sglang-runtime:1.1.0-cuda13`	`v0.5.10.post1`	AMD64/ARM64*	`v13.0`
`sglang-runtime:1.0.2`	`v0.5.9`	AMD64/ARM64	`v12.9`
`sglang-runtime:1.0.2-cuda13`	`v0.5.9`	AMD64/ARM64*	`v13.0`
`sglang-runtime:1.0.1`	`v0.5.9`	AMD64/ARM64	`v12.9`
`sglang-runtime:1.0.1-cuda13`	`v0.5.9`	AMD64/ARM64*	`v13.0`
`sglang-runtime:1.0.0`	`v0.5.9`	AMD64/ARM64	`v12.9`
`sglang-runtime:1.0.0-cuda13`	`v0.5.9`	AMD64/ARM64*	`v13.0`
`sglang-runtime:0.9.1`	`v0.5.8`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.9.1-cuda13`	`v0.5.8`	AMD64/ARM64*	`v13.0`	Experimental
`sglang-runtime:0.9.0`	`v0.5.8`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.9.0-cuda13`	`v0.5.8`	AMD64/ARM64*	`v13.0`	Experimental
`sglang-runtime:0.8.1`	`v0.5.6.post2`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.8.1-cuda13`	`v0.5.6.post2`	AMD64/ARM64	`v13.0`	Experimental
`sglang-runtime:0.8.0`	`v0.5.6.post2`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.8.0-cuda13`	`v0.5.6.post2`	AMD64/ARM64	`v13.0`	Experimental
`sglang-runtime:0.7.1`	`v0.5.4.post3`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.7.0.post1`	`v0.5.4.post3`	AMD64/ARM64	`v12.9`	Patch
`sglang-runtime:0.7.0`	`v0.5.4.post3`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.6.1.post1`	`v0.5.3.post2`	AMD64/ARM64	`v12.9`	Patch
`sglang-runtime:0.6.1`	`v0.5.3.post2`	AMD64/ARM64	`v12.9`
`sglang-runtime:0.6.0`	`v0.5.3.post2`	AMD64	`v12.8`

tensorrtllm-runtime

Image:Tag	TRT-LLM	Arch	CUDA	Notes
`tensorrtllm-runtime:1.1.0`	`v1.3.0rc11`	AMD64/ARM64	`v13.1`
`tensorrtllm-runtime:1.1.0-efa-amd64`	`v1.3.0rc11`	AMD64	`v13.1`	Experimental
`tensorrtllm-runtime:1.0.2`	`v1.3.0rc5.post1`	AMD64/ARM64	`v13.1`
`tensorrtllm-runtime:1.0.2-efa-amd64`	`v1.3.0rc5.post1`	AMD64	`v13.1`	Experimental
`tensorrtllm-runtime:1.0.1`	`v1.3.0rc5.post1`	AMD64/ARM64	`v13.1`
`tensorrtllm-runtime:1.0.1-efa-amd64`	`v1.3.0rc5.post1`	AMD64	`v13.1`	Experimental
`tensorrtllm-runtime:1.0.0`	`v1.3.0rc5.post1`	AMD64/ARM64	`v13.1`
`tensorrtllm-runtime:1.0.0-efa-amd64`	`v1.3.0rc5.post1`	AMD64	`v13.1`	Experimental
`tensorrtllm-runtime:0.9.1`	`v1.3.0rc3`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.9.0`	`v1.3.0rc1`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.8.1.post3`	`v1.2.0rc6.post3`	AMD64/ARM64	`v13.0`	Patch
`tensorrtllm-runtime:0.8.1.post1`	`v1.2.0rc6.post2`	AMD64/ARM64	`v13.0`	Patch
`tensorrtllm-runtime:0.8.1`	`v1.2.0rc6.post1`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.8.0`	`v1.2.0rc6.post1`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.7.0.post2`	`v1.2.0rc2`	AMD64/ARM64	`v13.0`	Patch
`tensorrtllm-runtime:0.7.1`	`v1.2.0rc3`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.7.0.post1`	`v1.2.0rc3`	AMD64/ARM64	`v13.0`	Patch
`tensorrtllm-runtime:0.7.0`	`v1.2.0rc2`	AMD64/ARM64	`v13.0`
`tensorrtllm-runtime:0.6.1-cuda13`	`v1.2.0rc1`	AMD64/ARM64	`v13.0`	Experimental
`tensorrtllm-runtime:0.6.1.post1`	`v1.1.0rc5`	AMD64/ARM64	`v12.9`	Patch
`tensorrtllm-runtime:0.6.1`	`v1.1.0rc5`	AMD64/ARM64	`v12.9`
`tensorrtllm-runtime:0.6.0`	`v1.1.0rc5`	AMD64/ARM64	`v12.9`

dynamo-frontend

Image:Tag	Arch	Notes
`dynamo-frontend:1.1.0`	AMD64/ARM64
`dynamo-frontend:1.0.2`	AMD64/ARM64
`dynamo-frontend:1.0.1`	AMD64/ARM64
`dynamo-frontend:1.0.0`	AMD64/ARM64
`dynamo-frontend:0.9.1`	AMD64/ARM64
`dynamo-frontend:0.9.0`	AMD64/ARM64
`dynamo-frontend:0.8.1`	AMD64/ARM64
`dynamo-frontend:0.8.0`	AMD64/ARM64	Initial

kubernetes-operator

Image:Tag	Arch	Notes
`kubernetes-operator:1.1.0`	AMD64/ARM64
`kubernetes-operator:1.0.2`	AMD64/ARM64
`kubernetes-operator:1.0.1`	AMD64/ARM64
`kubernetes-operator:1.0.0`	AMD64/ARM64
`kubernetes-operator:0.9.1`	AMD64/ARM64
`kubernetes-operator:0.9.0`	AMD64/ARM64
`kubernetes-operator:0.8.1`	AMD64/ARM64
`kubernetes-operator:0.8.0`	AMD64/ARM64
`kubernetes-operator:0.7.1`	AMD64/ARM64
`kubernetes-operator:0.7.0.post1`	AMD64/ARM64	Patch
`kubernetes-operator:0.7.0`	AMD64/ARM64
`kubernetes-operator:0.6.1`	AMD64/ARM64
`kubernetes-operator:0.6.0`	AMD64/ARM64

snapshot-agent

Image:Tag	Arch	Notes
`snapshot-agent:1.1.0`	AMD64/ARM64	Preview
`snapshot-agent:1.0.2`	AMD64/ARM64	Preview
`snapshot-agent:1.0.1`	AMD64/ARM64	Preview
`snapshot-agent:1.0.0`	AMD64/ARM64	Preview

Python Wheels

PyPI: ai-dynamo | ai-dynamo-runtime | kvbm

To access a specific version: https://pypi.org/project/{package}/{version}/

ai-dynamo (wheel)

Package	Python	Platform	Notes
`ai-dynamo==1.1.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==1.0.2`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==1.0.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==1.0.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.9.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.9.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.8.1.post3`	`3.10`–`3.12`	Linux (glibc `v2.28+`)	TRT-LLM `v1.2.0rc6.post3`
`ai-dynamo==0.8.1.post1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)	TRT-LLM `v1.2.0rc6.post2`
`ai-dynamo==0.8.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.8.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.7.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.7.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.6.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo==0.6.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)

ai-dynamo-runtime (wheel)

Package	Python	Platform	Notes
`ai-dynamo-runtime==1.1.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==1.0.2`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==1.0.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==1.0.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.9.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.9.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.8.1.post3`	`3.10`–`3.12`	Linux (glibc `v2.28+`)	TRT-LLM `v1.2.0rc6.post3`
`ai-dynamo-runtime==0.8.1.post1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)	TRT-LLM `v1.2.0rc6.post2`
`ai-dynamo-runtime==0.8.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.8.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.7.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.7.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.6.1`	`3.10`–`3.12`	Linux (glibc `v2.28+`)
`ai-dynamo-runtime==0.6.0`	`3.10`–`3.12`	Linux (glibc `v2.28+`)

kvbm (wheel)

Package	Python	Platform	Notes
`kvbm==1.1.0`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==1.0.2`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==1.0.1`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==1.0.0`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.9.1`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.9.0`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.8.1`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.8.0`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.7.1`	`3.12`	Linux (glibc `v2.28+`)
`kvbm==0.7.0`	`3.12`	Linux (glibc `v2.28+`)	Initial

Helm Charts

NGC Helm Registry: ai-dynamo

Direct download: https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/{chart}-{version}.tgz

dynamo-crds (Helm chart) -- Deprecated

Note

The dynamo-crds Helm chart is deprecated as of v1.0.0. CRDs are now managed by the Dynamo Operator.

Chart	Notes
`dynamo-crds-0.9.1`	Last release
`dynamo-crds-0.9.0`
`dynamo-crds-0.8.1`
`dynamo-crds-0.8.0`
`dynamo-crds-0.7.1`
`dynamo-crds-0.7.0`
`dynamo-crds-0.6.1`
`dynamo-crds-0.6.0`

dynamo-platform (Helm chart)

Chart	Notes
`dynamo-platform-1.1.0`
`dynamo-platform-1.0.2`
`dynamo-platform-1.0.1`
`dynamo-platform-1.0.0`
`dynamo-platform-0.9.1`
`dynamo-platform-0.9.0-post1`	Helm fix: operator image tag
`dynamo-platform-0.9.0`
`dynamo-platform-0.8.1`
`dynamo-platform-0.8.0`
`dynamo-platform-0.7.1`
`dynamo-platform-0.7.0`
`dynamo-platform-0.6.1`
`dynamo-platform-0.6.0`

snapshot (Helm chart)

Chart	Notes
`snapshot-1.1.0`	Preview
`snapshot-1.0.2`	Preview
`snapshot-1.0.1`	Preview
`snapshot-1.0.0`	Preview

dynamo-graph (Helm chart) -- Deprecated

Note

The dynamo-graph Helm chart is deprecated as of v0.9.0.

Chart	Notes
`dynamo-graph-0.8.1`	Last release
`dynamo-graph-0.8.0`
`dynamo-graph-0.7.1`
`dynamo-graph-0.7.0`
`dynamo-graph-0.6.1`
`dynamo-graph-0.6.0`

Rust Crates

crates.io: dynamo-runtime | dynamo-llm | dynamo-protocols | dynamo-parsers | dynamo-memory | dynamo-config | dynamo-tokens

To access a specific version: https://crates.io/crates/{crate}/{version}

dynamo-runtime (crate)

Crate	MSRV (Rust)	Notes
`dynamo-runtime@1.1.0`	`v1.82`
`dynamo-runtime@1.0.2`	`v1.82`
`dynamo-runtime@1.0.1`	`v1.82`
`dynamo-runtime@1.0.0`	`v1.82`
`dynamo-runtime@0.9.1`	`v1.82`
`dynamo-runtime@0.9.0`	`v1.82`
`dynamo-runtime@0.8.1`	`v1.82`
`dynamo-runtime@0.8.0`	`v1.82`
`dynamo-runtime@0.7.1`	`v1.82`
`dynamo-runtime@0.7.0`	`v1.82`
`dynamo-runtime@0.6.1`	`v1.82`
`dynamo-runtime@0.6.0`	`v1.82`

dynamo-llm (crate)

Crate	MSRV (Rust)	Notes
`dynamo-llm@1.1.0`	`v1.82`
`dynamo-llm@1.0.2`	`v1.82`
`dynamo-llm@1.0.1`	`v1.82`
`dynamo-llm@1.0.0`	`v1.82`
`dynamo-llm@0.9.1`	`v1.82`
`dynamo-llm@0.9.0`	`v1.82`
`dynamo-llm@0.8.1`	`v1.82`
`dynamo-llm@0.8.0`	`v1.82`
`dynamo-llm@0.7.1`	`v1.82`
`dynamo-llm@0.7.0`	`v1.82`
`dynamo-llm@0.6.1`	`v1.82`
`dynamo-llm@0.6.0`	`v1.82`

dynamo-protocols (crate)

Crate	MSRV (Rust)	Notes
`dynamo-protocols@1.1.0`	`v1.82`
`dynamo-protocols@1.0.2`	`v1.82`
`dynamo-protocols@1.0.1`	`v1.82`
`dynamo-protocols@1.0.0`	`v1.82`
`dynamo-protocols@0.9.1`	`v1.82`
`dynamo-protocols@0.9.0`	`v1.82`
`dynamo-protocols@0.8.1`	`v1.82`
`dynamo-protocols@0.8.0`	`v1.82`
`dynamo-protocols@0.7.1`	`v1.82`
`dynamo-protocols@0.7.0`	`v1.82`
`dynamo-protocols@0.6.1`	`v1.82`
`dynamo-protocols@0.6.0`	`v1.82`

dynamo-parsers (crate)

Crate	MSRV (Rust)	Notes
`dynamo-parsers@1.1.0`	`v1.82`
`dynamo-parsers@1.0.2`	`v1.82`
`dynamo-parsers@1.0.1`	`v1.82`
`dynamo-parsers@1.0.0`	`v1.82`
`dynamo-parsers@0.9.1`	`v1.82`
`dynamo-parsers@0.9.0`	`v1.82`
`dynamo-parsers@0.8.1`	`v1.82`
`dynamo-parsers@0.8.0`	`v1.82`
`dynamo-parsers@0.7.1`	`v1.82`
`dynamo-parsers@0.7.0`	`v1.82`
`dynamo-parsers@0.6.1`	`v1.82`
`dynamo-parsers@0.6.0`	`v1.82`

dynamo-memory (crate)

Crate	MSRV (Rust)	Notes
`dynamo-memory@1.1.0`	`v1.82`
`dynamo-memory@1.0.2`	`v1.82`
`dynamo-memory@1.0.1`	`v1.82`
`dynamo-memory@1.0.0`	`v1.82`
`dynamo-memory@0.9.1`	`v1.82`
`dynamo-memory@0.9.0`	`v1.82`
`dynamo-memory@0.8.1`	`v1.82`
`dynamo-memory@0.8.0`	`v1.82`	Initial

dynamo-config (crate)

Crate	MSRV (Rust)	Notes
`dynamo-config@1.1.0`	`v1.82`
`dynamo-config@1.0.2`	`v1.82`
`dynamo-config@1.0.1`	`v1.82`
`dynamo-config@1.0.0`	`v1.82`
`dynamo-config@0.9.1`	`v1.82`
`dynamo-config@0.9.0`	`v1.82`
`dynamo-config@0.8.1`	`v1.82`
`dynamo-config@0.8.0`	`v1.82`	Initial

dynamo-tokens (crate)

Crate	MSRV (Rust)	Notes
`dynamo-tokens@1.1.0`	`v1.82`
`dynamo-tokens@1.0.2`	`v1.82`
`dynamo-tokens@1.0.1`	`v1.82`
`dynamo-tokens@1.0.0`	`v1.82`
`dynamo-tokens@0.9.1`	`v1.82`
`dynamo-tokens@0.9.0`	`v1.82`	Initial

dynamo-mocker (crate)

Crate	MSRV (Rust)	Notes
`dynamo-mocker@1.1.0`	`v1.82`
`dynamo-mocker@1.0.2`	`v1.82`
`dynamo-mocker@1.0.1`	`v1.82`
`dynamo-mocker@1.0.0`	`v1.82`	Initial

dynamo-kv-router (crate)

Crate	MSRV (Rust)	Notes
`dynamo-kv-router@1.1.0`	`v1.82`
`dynamo-kv-router@1.0.2`	`v1.82`
`dynamo-kv-router@1.0.1`	`v1.82`
`dynamo-kv-router@1.0.0`	`v1.82`	Initial

Pre-Release Artifacts

Warning

Pre-Release artifacts do not go through QA validation. Pre-release versions are experimental previews intended for early testing and feedback. They may contain bugs, breaking changes, or incomplete features. Use stable releases for production workloads.

Pre-release Python wheels are published on the NVIDIA package index at pypi.nvidia.com, not on the public PyPI index. Like stable wheels, they are Linux (manylinux) builds for the Python versions in the Support Matrix; pip/uv on macOS or Windows will not find matching wheels. Install on a supported Linux host or inside a Linux container.

Install by adding that URL as an extra index and allowing pre-releases (PEP 440 dev versions):

# uv (recommended in other Dynamo docs)
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo==1.1.0.dev2

# pip
pip install --pre --extra-index-url https://pypi.nvidia.com ai-dynamo==1.1.0.dev2

A GitHub or container tag v1.1.0-dev.N maps to a wheel version 1.1.0.devN (for example v1.1.0-dev.2 → ==1.1.0.dev2). Optional extras such as ai-dynamo[vllm] use the same flags; pin the version you want from the sections below.

v1.2.0-deepseek-v4-dev.2

Branch: release/1.2.0-deepseek-v4-dev.2
GitHub Tag: v1.2.0-deepseek-v4-dev.2
Backends: vLLM v0.20.0 (native DeepSeek-V4 support) | SGLang upstream lmsysorg/sglang:deepseek-v4-blackwell preview | NIXL v0.10.1
Coverage: Partial -- DeepSeek-V4-Flash and V4-Pro only. vLLM and SGLang containers are published for Blackwell; no TensorRT-LLM container, no other component containers, no Helm charts, no wheels. Snapshot dev build for early-access V4 model support; not QA-gated.

Container Images

Image:Tag	Backend	CUDA	Arch
`vllm-runtime:1.2.0-deepseek-v4-cuda13-dev.2`	vLLM `v0.20.0`	`v13.0`	AMD64/ARM64
`sglang-runtime:1.2.0-deepseek-v4-cuda12-dev.2`	SGLang upstream DSv4 preview	`v12.9`	AMD64
`sglang-runtime:1.2.0-deepseek-v4-cuda13-dev.2`	SGLang upstream DSv4 preview	`v13.0`	ARM64

Python Wheels

Not published for this dev release. Use the v1.1.0 wheels or v1.1.0-dev.3 from pypi.nvidia.com.

Helm Charts

Not published for this dev release. Use v1.1.0 charts for platform install.

Rust Crates

Not shipped for pre-release versions.

v1.1.0-dev.3

Branch: release/1.1.0-dev.3
GitHub Tag: v1.1.0-dev.3
Backends (branch ToT): SGLang v0.5.10.post1 | TensorRT-LLM v1.3.0rc11 | vLLM v0.19.0 | NIXL v0.10.1
Coverage: Partial -- only the TensorRT-LLM container and the ai-dynamo / ai-dynamo-runtime wheels are published. SGLang and vLLM containers, additional component containers (dynamo-frontend, kubernetes-operator, snapshot-agent), the kvbm wheel, and Helm charts are not published for this dev release.

Container Images

Image:Tag	Backend	CUDA	Arch
`tensorrtllm-runtime:1.1.0-dev.3`	TRT-LLM `v1.3.0rc11`	`v13.1`	AMD64/ARM64

Python Wheels

Available from pypi.nvidia.com (pre-release index):

uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo==1.1.0.dev3
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo-runtime==1.1.0.dev3

kvbm==1.1.0.dev3 is not yet published.

Helm Charts

Not published for this dev release. Use the latest stable (v1.1.0) for platform install.

Rust Crates

Not shipped for pre-release versions.

v1.1.0-dev.2

Branch: release/1.1.0-dev.2
GitHub Tag: v1.1.0-dev.2
Backends (branch ToT): SGLang v0.5.9 | TensorRT-LLM v1.3.0rc9 | vLLM v0.19.0 | NIXL v0.10.1
Coverage: Partial -- SGLang and TensorRT-LLM containers plus ai-dynamo, ai-dynamo-runtime, and kvbm wheels are published. vLLM container, additional component containers (dynamo-frontend, kubernetes-operator, snapshot-agent), and Helm charts are not published for this dev release.

Container Images

Image:Tag	Backend	CUDA	Arch
`sglang-runtime:1.1.0-dev.2`	SGLang `v0.5.9`	`v12.9`	AMD64/ARM64
`tensorrtllm-runtime:1.1.0-dev.2`	TRT-LLM `v1.3.0rc9`	`v13.1`	AMD64/ARM64

Python Wheels

Available from pypi.nvidia.com (pre-release index):

uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo==1.1.0.dev2
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo-runtime==1.1.0.dev2
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ kvbm==1.1.0.dev2

Helm Charts

Not published for this dev release. Use the latest stable (v1.1.0) for platform install.

Rust Crates

Not shipped for pre-release versions.

v1.1.0-dev.1

Branch: release/1.1.0-dev.1
GitHub Tag: v1.1.0-dev.1
Backends: SGLang v0.5.9 | TensorRT-LLM v1.3.0rc5.post1 | vLLM v0.17.1 | NIXL v0.10.1

Container Images

Image:Tag	Backend	CUDA	Arch
`vllm-runtime:1.1.0-dev.1`	vLLM `v0.17.1`	`v12.9`	AMD64/ARM64
`vllm-runtime:1.1.0-dev.1-cuda13`	vLLM `v0.17.1`	`v13.0`	AMD64/ARM64*
`vllm-runtime:1.1.0-dev.1-efa-amd64`	vLLM `v0.17.1`	`v12.9`	AMD64
`sglang-runtime:1.1.0-dev.1`	SGLang `v0.5.9`	`v12.9`	AMD64/ARM64
`sglang-runtime:1.1.0-dev.1-cuda13`	SGLang `v0.5.9`	`v13.0`	AMD64/ARM64*
`tensorrtllm-runtime:1.1.0-dev.1`	TRT-LLM `v1.3.0rc5.post1`	`v13.1`	AMD64/ARM64
`tensorrtllm-runtime:1.1.0-dev.1-efa-amd64`	TRT-LLM `v1.3.0rc5.post1`	`v13.1`	AMD64
`dynamo-frontend:1.1.0-dev.1`	—	—	AMD64/ARM64
`kubernetes-operator:1.1.0-dev.1`	—	—	AMD64/ARM64
`snapshot-agent:1.1.0-dev.1`	—	—	AMD64/ARM64

Python Wheels

Available from pypi.nvidia.com (pre-release index):

uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo==1.1.0.dev1
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ ai-dynamo-runtime==1.1.0.dev1
uv pip install --pre --extra-index-url https://pypi.nvidia.com/ kvbm==1.1.0.dev1

Helm Charts

Chart	NGC
`dynamo-platform-1.1.0-dev.1`	link
`snapshot-1.1.0-dev.1`	link

Rust Crates

Not shipped for pre-release versions.

FilesExpand file tree

release-artifacts.md

Latest commit

History

release-artifacts.md

File metadata and controls

Current Release: Dynamo v1.1.0

Container Images

Python Wheels

Helm Charts

Rust Crates

Quick Install Commands

Container Images (NGC)

Python Wheels (PyPI)

Helm Charts (NGC)

Rust Crates (crates.io)

Known Issues

Known Artifact Issues

Release History

GitHub Releases

Container Images

vllm-runtime

sglang-runtime

tensorrtllm-runtime

dynamo-frontend

kubernetes-operator

snapshot-agent

Python Wheels

ai-dynamo (wheel)

ai-dynamo-runtime (wheel)

kvbm (wheel)

Helm Charts

dynamo-crds (Helm chart) -- Deprecated

dynamo-platform (Helm chart)

snapshot (Helm chart)

dynamo-graph (Helm chart) -- Deprecated

Rust Crates

dynamo-runtime (crate)

dynamo-llm (crate)

dynamo-protocols (crate)

dynamo-parsers (crate)

dynamo-memory (crate)

dynamo-config (crate)

dynamo-tokens (crate)

dynamo-mocker (crate)

dynamo-kv-router (crate)

Pre-Release Artifacts

v1.2.0-deepseek-v4-dev.2

Container Images

Python Wheels

Helm Charts

Rust Crates

v1.1.0-dev.3

Container Images

Python Wheels

Helm Charts

Rust Crates

v1.1.0-dev.2

Container Images

Python Wheels

Helm Charts

Rust Crates

v1.1.0-dev.1

Container Images

Python Wheels

Helm Charts

Rust Crates