Skip to content

Commit bc4f56b

Browse files
committed
docs: rewrite README opening to match scaffold-lint/agent-convergence-scorer flow
Previous opening was manifesto-style and pre-stated the pain, making the Pain section feel redundant. New flow follows the pattern other launch-grade Hermes repos use: title → bold what-it-is one-liner + elaboration → badges → if-you're-X bridge sentence → user-voice Pain bullets Pain bullets sharpened with concrete numbers and second-person voice.
1 parent b363a74 commit bc4f56b

1 file changed

Lines changed: 9 additions & 8 deletions

File tree

README.md

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,22 @@
11
# hermes-blind
22

3+
**Context-compensation scaffold for LLM evaluation prompts.** A ~40-token language prefix that makes the model disclose prior exposure, score on quoted evidence only, and hedge on thin evidence — so the same prompt stops scoring 6.8 on one run and 8.4 on the next.
4+
35
[![PyPI](https://img.shields.io/pypi/v/hermes-blind.svg)](https://pypi.org/project/hermes-blind/)
46
[![Python](https://img.shields.io/pypi/pyversions/hermes-blind.svg)](https://pypi.org/project/hermes-blind/)
57
[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
68
[![Status: experimental](https://img.shields.io/badge/status-experimental-orange.svg)](#status)
9+
[![Hermes Seal](https://img.shields.io/badge/hermes--seal-manifest%20staged-blue)](.hermes-seal.yaml)
710

8-
**The same eval prompt should not score 6.8 on one run and 8.4 on the next.** Context, memory, and knowledge of authorship bias the scorer. `hermes-blind` is a ~40-token language scaffold you prepend to any scoring or evaluation prompt to force the model to disclose prior exposure, score on quoted evidence only, and hedge on thin evidence.
9-
10-
It is a string. No model. No API. Backend-agnostic.
11+
If you're scoring with an LLM that has access to your CLAUDE.md, memory, or session transcript — and the eval is supposed to be neutral but you can feel the model flattering you — this is the string you prepend to the prompt.
1112

1213
## Pain
1314

14-
- Same prompt, same target, different run → different score. No audit trail for which score is real.
15-
- Claude scoring code it just wrote. The model knows. The score is inflated.
16-
- CLAUDE.md, memory files, and session context leak into the rubric's judgment and the scorer optimizes to the owner's preferences instead of the target's evidence.
17-
- You want a second opinion, but the second opinion is the same model that has the same context.
18-
- `claude --bare` fixes this for the `claude-cli` backend only. Ollama, Sonnet-via-Bedrock, in-session scoring, and everyone else get nothing.
15+
- Same prompt, same target, two runs, two scores: 6.8 and 8.4. No way to tell which is real.
16+
- Claude scoring code Claude just wrote. The model knows it authored the target. The score is inflated and you can't measure by how much.
17+
- The scorer reads your `CLAUDE.md` and your memory files; it learns your preferences and grades to please you, not to surface evidence.
18+
- You wanted a second opinion. The second opinion is the same model with the same session context. It is not a second opinion.
19+
- `claude --bare` solves this for `claude-cli` only. Anything you score through Ollama, OpenAI, or any in-session call gets nothing.
1920

2021
## Install
2122

0 commit comments

Comments
 (0)