Skip to content

Commit 4ae1228

Browse files
committed
docs: scope consensus determinism guarantee
1 parent 65a25eb commit 4ae1228

2 files changed

Lines changed: 6 additions & 5 deletions

File tree

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -197,9 +197,9 @@ Consensus mode keeps a finding only when it appears in more than half of the
197197
configured runs. When those votes disagree on severity, the highest observed
198198
severity wins, independent of response order. Failed runs and successful runs
199199
that omit the finding cast no vote but remain in the denominator. This makes
200-
aggregation stable for majority-agreed findings; it does not make an individual
201-
LLM sample deterministic, so single-run output and non-majority findings can
202-
still vary between scans.
200+
severity selection stable for majority-agreed findings. It does not make an
201+
individual LLM sample deterministic, and descriptive fields from equal-severity
202+
votes, single-run output, and non-majority findings can still vary between scans.
203203

204204
**LLM provider note:** `--llm-provider` currently accepts `anthropic` or `openai`.
205205
For Bedrock, Vertex, Azure, Gemini, and other LiteLLM backends, set provider-specific model strings and environment variables (see [LLM Analyzer docs](docs/architecture/analyzers/llm-analyzer.md)).

docs/architecture/analyzers/llm-analyzer.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -215,8 +215,9 @@ remain in the configured-run denominator. Retained findings include agreement,
215215
severity-vote, successful-run, and failed-run metadata so callers can assess
216216
the evidence behind the result.
217217

218-
Consensus makes aggregation deterministic once a finding reaches majority. It
219-
does not make the underlying model deterministic: a single run can still vary,
218+
Consensus makes severity selection deterministic once a finding reaches
219+
majority. It does not make the underlying model deterministic: descriptive
220+
fields from equal-severity votes can still vary, a single run can still vary,
220221
and a finding near the majority boundary can still appear or disappear between
221222
separate scans.
222223

0 commit comments

Comments
 (0)