[VDR][v0.6.0] DOC-5be47580 · Reverify tutorial's Hydra override targets a config key that does not exist

[anwithk]

Severity: 🟠 high | Category: Documentation | Finding ID: DOC-5be47580

Location: fern/versions/latest/pages/evaluation-tutorials/reverify-rollouts.mdx:110

Problem

The 'Hydra overrides work the same as in other gym eval commands' example uses "++mcqa_resources_server.resources_servers.mcqa.grading_mode=strict_single_letter_boxed". The top-level key is mcqa, not mcqa_resources_server — see resources_servers/mcqa/configs/mcqa.yaml:1 and the page's own example config four blocks earlier at :39. No bare mcqa_resources_server key exists anywhere under resources_servers/, benchmarks/, or environments/. reference/cli-commands.mdx:768 gets the same example right (++mcqa.resources_servers.mcqa.grading_mode=lenient_boxed), so the two pages contradict each other. Copy-pasting the tutorial version adds a dead key that silently does nothing to the verifier.

Suggested fix

Change :110 to "++mcqa.resources_servers.mcqa.grading_mode=strict_single_letter_boxed" to match resources_servers/mcqa/configs/mcqa.yaml:1 and reference/cli-commands.mdx:768.

Evidence

reverify-rollouts.mdx:110 `++mcqa_resources_server.resources_servers.mcqa...` vs `head -3 resources_servers/mcqa/configs/mcqa.yaml` -> `mcqa:` / `  resources_servers:` / `    mcqa:`

---

_{Found by the doc-reviewer critic in DX review Gym-1-20260821203248 — incremental from v0.5.0 to fa0d25158. Parent tracker #2214.}