Skip to content
Merged
Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
58e3d19
feat(kubernetes): add GPU autoscaling recipe with optional Envoy
maggiezha Aug 11, 2026
654dfe3
fix(kubernetes): address PR review — GPU-only HPA, pathType, redactions
maggiezha Aug 11, 2026
b7f904a
docs(kubernetes): drop Boundaries blurb from validated hardware
maggiezha Aug 11, 2026
13a38e1
Enhance README with HPA scale-up examples
maggiezha Aug 11, 2026
3530a7e
Update README for GPU autoscaling clarity
maggiezha Aug 11, 2026
f0c5047
feat(kubernetes): document GPU util and latency HPA examples
maggiezha Aug 11, 2026
808f35e
docs(kubernetes): restore user HPA screenshot captions and markup
maggiezha Aug 11, 2026
8ee1df4
polish README
maggiezha Aug 11, 2026
b2c94a0
Update README with new image and load balancing details
maggiezha Aug 11, 2026
98c3bb4
Update scripts section in GPU autoscaling README
maggiezha Aug 11, 2026
1b90fdd
chore(kubernetes): remove unused cluster-recover script
maggiezha Aug 11, 2026
862d843
Enhance README for Kubernetes GPU autoscaling
maggiezha Aug 11, 2026
129ad7f
Fix formatting in GPU autoscaling README
maggiezha Aug 11, 2026
7ecfd92
Clarify OpenShell sandbox description in README
maggiezha Aug 11, 2026
43b4f58
Clarify GPU HPA recipe naming, local TLS env, and demo ergonomics.
maggiezha Aug 12, 2026
6538b0f
Fix legacy *-agent → *-metrics-proxy upgrade migration.
maggiezha Aug 12, 2026
2f4db23
Enhance README with new images
maggiezha Aug 12, 2026
15442f9
Prefer metrics-proxy naming over historical agent wording.
maggiezha Aug 12, 2026
970c1db
fix(kubernetes): restore sanitized screenshots and migration order.
maggiezha Aug 12, 2026
c8b0815
docs(kubernetes): clarify MAX_REPLICAS and TARGET_PODS both mean N.
maggiezha Aug 12, 2026
478b3d6
docs(kubernetes): use and instead of slash for replica env vars.
maggiezha Aug 13, 2026
15193cf
Update README with images and PromQL examples
maggiezha Aug 13, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
52 changes: 52 additions & 0 deletions THIRD-PARTY-NOTICES
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,14 @@ Image: vllm/vllm-openai
License: Apache-2.0 and included component licenses
URL: https://github.com/vllm-project/vllm

Image: node:22-bookworm-slim
License: MIT and included Debian component licenses
URL: https://hub.docker.com/_/node

Image: ollama/ollama
License: MIT and included component licenses
URL: https://github.com/ollama/ollama

================================================================================
Docker Compose Images
================================================================================
Expand Down Expand Up @@ -262,6 +270,46 @@ Project: NVIDIA/OpenShell installer and runtime
License: Apache-2.0
URL: https://github.com/NVIDIA/OpenShell

Project: NVIDIA/NemoClaw source and sandbox base image
License: Apache-2.0 and included component licenses
URL: https://github.com/NVIDIA/NemoClaw

Project: Kubernetes SIG Agent Sandbox controller and API
License: Apache-2.0
URL: https://github.com/kubernetes-sigs/agent-sandbox

Project: Kubernetes and kubectl
License: Apache-2.0
URL: https://github.com/kubernetes/kubernetes

Project: Helm
License: Apache-2.0
URL: https://github.com/helm/helm

Project: Canonical MicroK8s distribution
License: See the project and included component notices
URL: https://github.com/canonical/microk8s

Project: NVIDIA GPU Operator
License: Apache-2.0
URL: https://github.com/NVIDIA/gpu-operator

Project: NVIDIA DCGM Exporter
License: Apache-2.0
URL: https://github.com/NVIDIA/dcgm-exporter

Project: Kubernetes Metrics Server
License: Apache-2.0
URL: https://github.com/kubernetes-sigs/metrics-server

Project: Prometheus Community Helm Charts (kube-prometheus-stack and prometheus-adapter)
License: Apache-2.0 and included component licenses
URL: https://github.com/prometheus-community/helm-charts

Project: Kubernetes ingress-nginx
License: Apache-2.0
URL: https://github.com/kubernetes/ingress-nginx

Project: Astral uv installer and package manager
License: Apache-2.0 OR MIT
URL: https://github.com/astral-sh/uv
Expand All @@ -286,6 +334,10 @@ Model: NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
License: NVIDIA Open Model License
URL: https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Model: Llama 3.2 3B
License: Llama 3.2 Community License Agreement and Acceptable Use Policy
URL: https://ollama.com/library/llama3.2

Service: GitHub API
Terms: See provider terms
URL: https://docs.github.com/
Expand Down
1 change: 1 addition & 0 deletions examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ again by contributor provenance.
| Example | Description |
| --- | --- |
| [Developer Community Chief of Staff](recipes/nvidia/developer-community-chief-of-staff/README.md) | Synthesizes Slack, Outlook, GitHub, and mirrored community signals into operating briefs, gaps, priorities, and follow-up recommendations. |
| [Kubernetes GPU Autoscaling](recipes/nvidia/kubernetes-gpu-autoscaling/README.md) | Runs a CPU-only NemoClaw/OpenClaw sandbox through OpenShell on Kubernetes and autoscales authenticated, GPU-backed Ollama inference pods from DCGM utilization. |
| [NV Tech Assistant](recipes/nvidia/nv-tech-assistant/README.md) | Answers NVIDIA technical questions with cited evidence from allowlisted NVIDIA, GitHub, and arXiv sources. |
| [Payment Operations Hermes Assistant](recipes/nvidia/payment-ops-hermes/README.md) | Demonstrates constrained payment screening, evidence preparation, and a platform-enforced human release boundary. |
| [PR Review Advisor](recipes/nvidia/pr-review-advisor/README.md) | Reviews exact pull request heads with a constrained Hermes workflow, produces attested artifacts, and publishes only through a separate maintainer action. |
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Cluster-local overrides (see local.env.example)
local.env
hpa-tls-values.yaml
14 changes: 14 additions & 0 deletions examples/recipes/nvidia/kubernetes-gpu-autoscaling/Chart.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
apiVersion: v2
name: nemoclaw-gpu
description: GPU-backed Ollama inference pods on Kubernetes with GPU utilization HPA
type: application
version: 0.1.0
appVersion: "2026.05.27"
keywords:
- nemoclaw
- ollama
- gpu
maintainers:
- name: maggiezha
615 changes: 615 additions & 0 deletions examples/recipes/nvidia/kubernetes-gpu-autoscaling/README.md

Large diffs are not rendered by default.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading