Skip to content

Commit 17efe1a

Browse files
[CI] Also disable prompt caching for NVIDIA inference proxy
NVIDIA/OSMO's claude workflow (testbot-respond.yaml) sets BOTH CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS=1 and DISABLE_PROMPT_CACHING=1 because the NVIDIA gateway rejects two fields the SDK sends by default: `context_management` (beta) and `cache_control.ephemeral.scope` (prompt caching). Adding the second env var preemptively so we don't hit a follow-up 400 after the first fix lands. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
1 parent ece0b68 commit 17efe1a

2 files changed

Lines changed: 12 additions & 8 deletions

File tree

.github/workflows/claude.yml

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -68,11 +68,13 @@ jobs:
6868
uses: anthropics/claude-code-action@v1
6969
env:
7070
ANTHROPIC_BASE_URL: ${{ secrets.ANTHROPIC_BASE_URL }}
71-
# The NVIDIA inference proxy (LiteLLM-based) rejects the
72-
# `context_management` field that Claude Code's SDK sends by
73-
# default. Disabling experimental betas drops this field so
74-
# the proxy accepts the request.
71+
# NVIDIA inference proxy (LiteLLM-based) rejects two fields
72+
# the Claude Code SDK sends by default. Set per NVIDIA/OSMO's
73+
# workflow which has hit and solved both issues:
74+
# - `context_management` → disable experimental betas
75+
# - `cache_control.ephemeral.scope` → disable prompt caching
7576
CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS: "1"
77+
DISABLE_PROMPT_CACHING: "1"
7678
with:
7779
anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
7880
claude_args: |

.github/workflows/claude_review.yml

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -60,11 +60,13 @@ jobs:
6060
uses: anthropics/claude-code-action@v1
6161
env:
6262
ANTHROPIC_BASE_URL: ${{ secrets.ANTHROPIC_BASE_URL }}
63-
# The NVIDIA inference proxy (LiteLLM-based) rejects the
64-
# `context_management` field that Claude Code's SDK sends by
65-
# default. Disabling experimental betas drops this field so
66-
# the proxy accepts the request.
63+
# NVIDIA inference proxy (LiteLLM-based) rejects two fields
64+
# the Claude Code SDK sends by default. Set per NVIDIA/OSMO's
65+
# workflow which has hit and solved both issues:
66+
# - `context_management` → disable experimental betas
67+
# - `cache_control.ephemeral.scope` → disable prompt caching
6768
CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS: "1"
69+
DISABLE_PROMPT_CACHING: "1"
6870
with:
6971
anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
7072
trigger_phrase: "/claude review"

0 commit comments

Comments
 (0)