Skip to content

Commit 6ae4ebd

Browse files
authored
chore: update llama-stack to v0.7.1+rhaiv.1 (#334)
## Summary Update `CURRENT_LLAMA_STACK_VERSION` from `main` to `v0.7.1+rhaiv.1` Regenerated distribution artifacts via pre-commit. ## Source Tag: [`v0.7.1+rhaiv.1`](https://github.com/opendatahub-io/llama-stack/releases/tag/v0.7.1+rhaiv.1) Triggered by: [workflow run](https://github.com/opendatahub-io/llama-stack/actions/runs/24148289864) ## Test plan - [ ] Review the generated `distribution/Containerfile` changes - [ ] Verify the new tag exists in opendatahub-io/llama-stack - [ ] Merge and confirm the distribution container build succeeds ## Summary by CodeRabbit * **Chores** * Pinned runtime components to specific releases (v0.7.1+rhaiv.1 and client 0.7.2) for more reproducible, deterministic installs. * Switched client installation to a fixed package release instead of a moving branch/source fallback; build defaults adjusted to use these pinned versions. * **Documentation** * Updated distribution README to reference the v0.7.1+rhaiv.1 release. * **Tests** * Test harness now forwards the EMBEDDING_MODEL environment variable into the test container. Approved-by: cdoern Approved-by: Artemon-line
2 parents 33f1f34 + bcbde10 commit 6ae4ebd

4 files changed

Lines changed: 6 additions & 5 deletions

File tree

distribution/Containerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -66,8 +66,8 @@ RUN uv pip install \
6666
llama_stack_provider_trustyai_garak==0.3.1
6767
RUN uv pip install --extra-index-url https://download.pytorch.org/whl/cpu 'torchao>=0.12.0' torch torchvision
6868
RUN uv pip install --no-deps sentence-transformers
69-
RUN uv pip install --no-cache --no-deps git+https://github.com/opendatahub-io/llama-stack.git@main
70-
RUN uv pip install --no-cache --no-deps 'llama-stack-api@git+https://github.com/opendatahub-io/llama-stack.git@main#subdirectory=src/llama_stack_api'
69+
RUN uv pip install --no-cache --no-deps git+https://github.com/opendatahub-io/llama-stack.git@v0.7.1+rhaiv.1
70+
RUN uv pip install --no-cache --no-deps llama-stack-client==0.7.2
7171
RUN set -o pipefail && opentelemetry-bootstrap -a requirements | uv pip install --requirement -
7272
RUN mkdir -p ${HOME}/.llama ${HOME}/.cache
7373
# Pre-cache tiktoken cl100k_base encoding to avoid runtime download

distribution/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
This image contains the official Open Data Hub Llama Stack distribution, with all the packages and configuration needed to run a Llama Stack server in a containerized environment.
66

7-
The image is currently shipping with the Open Data Hub version of Llama Stack version [main](https://github.com/opendatahub-io/llama-stack/tree/main)
7+
The image is currently shipping with the Open Data Hub version of Llama Stack version [0.7.1](https://github.com/opendatahub-io/llama-stack/releases/tag/v0.7.1)
88

99
You can see an overview of the APIs and Providers the image ships with in the table below.
1010

distribution/build.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,10 +15,10 @@
1515
import shlex
1616
from pathlib import Path
1717

18-
CURRENT_LLAMA_STACK_VERSION = "main"
18+
CURRENT_LLAMA_STACK_VERSION = "v0.7.1+rhaiv.1"
1919
LLAMA_STACK_VERSION = os.getenv("LLAMA_STACK_VERSION", CURRENT_LLAMA_STACK_VERSION)
2020
LLAMA_STACK_CLIENT_VERSION = (
21-
None # Set to None to auto-derive from LLAMA_STACK_VERSION, or set explicit version
21+
"0.7.2" # Explicit version; set to None to auto-derive from LLAMA_STACK_VERSION
2222
)
2323
BASE_REQUIREMENTS = [
2424
f"llama-stack=={LLAMA_STACK_VERSION}",

tests/smoke.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ function start_and_wait_for_llama_stack_container {
1616
--pull=never
1717
--net=host
1818
-p 8321:8321
19+
--env "EMBEDDING_MODEL=$EMBEDDING_MODEL"
1920
--env "VLLM_URL=$VLLM_URL"
2021
--env "VLLM_EMBEDDING_URL=$VLLM_EMBEDDING_URL"
2122
--env "TRUSTYAI_LMEVAL_USE_K8S=False"

0 commit comments

Comments
 (0)