Commit 69217d9
authored
* fix(deps): bump transformers/torch/ray to mitigate CVEs (TRI-1421)
Bumps in tutorials/ examples to patched versions:
* style: black reformat for Quick_Deploy/PyTorch/export.py
Collapses an over-wrapped multi-line expression onto a single line
to satisfy black. Picked up by pre-commit run --all-files; not
otherwise related to TRI-1421.
* chore(versions): bump tutorials examples to 26.06 release
Aligns container references and pinned client versions with the
26.06 release (release_version 2.70.0, triton_container_version
26.06, upstream_container_version 26.05 per server/build.py):
- nvcr.io/nvidia/tritonserver XX.XX-* -> 26.06-*
(covers -py3, -py3-sdk, -vllm-python-py3, -trtllm-python-py3 across
Conceptual_Guide, Quick_Deploy, Popular_Models_Guide, Feature_Guide,
Deployment/Kubernetes, Triton_Inference_Server_Python_API)
- nvcr.io/nvidia/pytorch 23.05-py3 -> 26.05-py3
- nvcr.io/nvidia/tensorflow 24.04-tf2-py3 -> 26.05-tf2-py3
- tritonclient 2.47.0 -> 2.70.0 (kafka-io example)
- Internal image tag triton-python-api:r24.08 -> r26.06 in
Triton_Inference_Server_Python_API/README.md
Placeholder references (yy.mm, xx.yy, <yy.mm>) intentionally left
unchanged. Examples that span multiple release trains may need
follow-up code adjustments to keep working against the new SDK.
* fix(deps): correct tritonclient pin to 2.69.0 (latest on PyPI)
The 26.06 server build reports version 2.70.0 but the tritonclient
wheel for 2.70.0 has not been published to PyPI yet (latest published
is 2.69.0). Pinning the kafka-io example to 2.69.0 so pip install -r
requirements.txt resolves today. Bump to 2.70.0 once the wheel ships.
* fix(deps): bump sentencepiece pin to 0.2.1 for Python 3.12 wheel
The 26.06-py3 tritonserver image ships Python 3.12. sentencepiece
0.1.99 has no cp312 wheel and pip falls back to building from source,
which fails inside the container. 0.2.1 has a cp312 wheel and
installs cleanly. Verified by building the Dockerfile against the
staged tritonserver:26.06-py3 image.
* fix(versions): bump 24.08 -> 26.06 in Python_API build.sh / Dockerfile
Caught by the staged-image test pass: build.sh hardcoded
BASE_IMAGE_TAG_IDENTITY/DIFFUSION, the default TAG slug, and the
StableDiffusion sub-build references at 24.08. docker/Dockerfile
ARG BASE_IMAGE_TAG also defaulted to 24.08-py3. Aligned all to
26.06. The earlier sweep missed these because the regex looked
for nvcr.io / tritonserver: prefixes; the literals lived as bare
shell-variable values.
1 parent 4fe2b90 commit 69217d9
23 files changed
Lines changed: 49 additions & 55 deletions
File tree
- Conceptual_Guide
- Part_4-inference_acceleration
- Part_5-Model_Ensembles
- Deployment/Kubernetes
- EKS_Multinode_Triton_TRTLLM/multinode_helm_chart
- containers
- TensorRT-LLM_Autoscaling_and_Load_Balancing
- containers
- TensorRT-LLM_Multi-Node_Distributed_Models/containers
- Feature_Guide/Speculative_Decoding/vLLM
- HuggingFace
- Popular_Models_Guide
- DeepSeek
- Llama2
- StableDiffusion
- Quick_Deploy
- HuggingFaceTransformers
- OpenVINO
- PyTorch
- Triton_Inference_Server_Python_API
- deps
- docker
- examples/kafka-io
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
135 | 135 | | |
136 | 136 | | |
137 | 137 | | |
138 | | - | |
| 138 | + | |
139 | 139 | | |
140 | 140 | | |
141 | | - | |
| 141 | + | |
142 | 142 | | |
143 | 143 | | |
144 | 144 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
315 | 315 | | |
316 | 316 | | |
317 | 317 | | |
318 | | - | |
| 318 | + | |
319 | 319 | | |
320 | 320 | | |
321 | 321 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
198 | 198 | | |
199 | 199 | | |
200 | 200 | | |
201 | | - | |
| 201 | + | |
202 | 202 | | |
203 | 203 | | |
204 | 204 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
115 | 115 | | |
116 | 116 | | |
117 | 117 | | |
118 | | - | |
| 118 | + | |
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
| |||
0 commit comments