Commit 041164b
hone: a green suite is not evidence a fix worked (#12)
Found in forkrul-woodpecker-CI spec 002. Round 3 of a hone run pointed a critic
at the fixes rounds 1-2 had produced, rather than at the implementation. Four of
six blocking findings were regressions HONE ITSELF had introduced -- three of
them credential leaks -- and every one shipped under a fully green suite.
The Cool phase required only "the full test suite must be green again", which is
exactly the condition that held while all four landed. A gate that cannot
distinguish a working fix from a broken one is the cannot-fail shape, sitting in
the skill that exists to find cannot-fail shapes.
The pipeline's own Golden Rule says fix the prompt before the code; for the
review stage this SKILL.md is the prompt.
- every fix must be shown to FAIL without itself (revert, watch red, restore)
- round N+1's panel reviews round N's fixes as part of the diff; a round whose
fixes went unreviewed cannot count as clean -- the rating measures what the
panel examined, same principle as the overlap cap
- a fix that moves a threshold must re-measure BOTH directions, including the
one that was fine before
- a spec edit written to justify a code change is the highest-risk edit in the
pipeline, because it removes the thing that would have contradicted the code;
its premise must be measured and the measurement shown
Co-authored-by: installer <installer@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>1 parent ebfc01e commit 041164b
1 file changed
Lines changed: 33 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
98 | 98 | | |
99 | 99 | | |
100 | 100 | | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
101 | 104 | | |
102 | 105 | | |
103 | 106 | | |
104 | 107 | | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
105 | 128 | | |
106 | 129 | | |
107 | 130 | | |
| |||
144 | 167 | | |
145 | 168 | | |
146 | 169 | | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
147 | 175 | | |
148 | 176 | | |
149 | 177 | | |
| |||
159 | 187 | | |
160 | 188 | | |
161 | 189 | | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
162 | 195 | | |
163 | 196 | | |
164 | 197 | | |
| |||
0 commit comments