File tree Expand file tree Collapse file tree
.cat/issues/v2/v2.1/add-model-id-to-test-results-schema Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1+ {
2+ "status" : " open"
3+ }
Original file line number Diff line number Diff line change 1+ # Plan
2+
3+ ## Goal
4+
5+ Add fully-qualified model ID to test-results schema so cached SPRT results are invalidated when the
6+ model changes.
7+
8+ ## Pre-conditions
9+
10+ (none)
11+
12+ ## Post-conditions
13+
14+ - [ ] Both skills results.json and rules test-results.json schemas include a fully-qualified model ID field (e.g., claude-haiku-4-5-20251001)
15+ - [ ] Tests passing for schema validation
16+ - [ ] Mismatch between stored model ID and current model ID is detectable and triggers re-validation
17+ - [ ] No regressions in existing test infrastructure
18+ - [ ] E2E verification: store a test result with model ID, change the model, verify the cached result is flagged as stale
You can’t perform that action at this time.
0 commit comments