All issues

Search results

Anthropic provider: ANTHROPIC_AUTH_TOKEN silently overrides an explicitly-supplied self.api_key

Status: Open.

#5304 In UKGovernmentBEIS/inspect_ai;

· Scott-Guest opened on Sep 8, 2026

Bedrock: reasoning_effort is silently ignored on the OpenAI GPT-5.6 models

Status: Open.

#5302 In UKGovernmentBEIS/inspect_ai;

· cory-nava opened on Sep 8, 2026

Bedrock: reasoning_effort on Nova Pro fails every sample with a ValidationException

Status: Open.

#5301 In UKGovernmentBEIS/inspect_ai;

· cory-nava opened on Sep 8, 2026

Bedrock: Claude reasoning replays as <think> text because the Converse signature is dropped at parse time

Status: Open.

#5300 In UKGovernmentBEIS/inspect_ai;

· cory-nava opened on Sep 8, 2026

bug: eval_set never reuses a completed log when the task sets a non-mean epochs_reducer

acceptedIssues: maintainer-approved for external PR — the gate keyIssues: maintainer-approved for external PR — the gate key

Status: Open.

#5296 In UKGovernmentBEIS/inspect_ai;

· MattFisher opened on Sep 8, 2026

bug: eval_config.approval in a run-config file crashes with AttributeError

Status: Open.

#5295 In UKGovernmentBEIS/inspect_ai;

· MattFisher opened on Sep 8, 2026

hf_dataset does not retry timeouts from modern Hugging Face clients

Status: Open.

#5279 In UKGovernmentBEIS/inspect_ai;

· cenab opened on Sep 7, 2026

Long asset downloads lose their retry allowance after the first minute

Status: Open.

#5277 In UKGovernmentBEIS/inspect_ai;

· cenab opened on Sep 7, 2026

Grading and multiple-choice templates still raise KeyError on unescaped JSON braces

Status: Open.

#5276 In UKGovernmentBEIS/inspect_ai;

· Sagexd08 opened on Sep 7, 2026

csv_dataset overrides the selected dialect delimiter with a comma

acceptedIssues: maintainer-approved for external PR — the gate keyIssues: maintainer-approved for external PR — the gate key

Status: Open.

#5273 In UKGovernmentBEIS/inspect_ai;

· cenab opened on Sep 7, 2026

JSONL URLs with query parameters still select the ordinary JSON reader

Status: Open.

#5271 In UKGovernmentBEIS/inspect_ai;

· cenab opened on Sep 7, 2026

Quoted command-line strings containing commas are parsed as lists

Status: Open.

#5269 In UKGovernmentBEIS/inspect_ai;

· cenab opened on Sep 7, 2026