|
11 | 11 | "-->\n", |
12 | 12 | "# 🕵️ Rewriting Biographies\n", |
13 | 13 | "\n", |
14 | | - "Instead of replacing entities with tokens, rewrite mode generates a\n", |
15 | | - "privacy-safe transformation of the entire text. The `run()` / `preview()` pipeline:\n", |
| 14 | + "Instead of replacing individual entities, rewrite mode transforms the entire\n", |
| 15 | + "text and measures any sensitive information that remains. The `run()` / `preview()` pipeline:\n", |
16 | 16 | "\n", |
17 | 17 | "1. Detects entities (same as replace mode, plus latent entity detection)\n", |
18 | 18 | "2. Classifies the domain and assigns sensitivity dispositions\n", |
|
800 | 800 | "source": [ |
801 | 801 | "## 🚩 Filter by review flag\n", |
802 | 802 | "\n", |
803 | | - "- Records where automated metrics exceed thresholds are flagged for manual review.\n", |
| 803 | + "- Records that cross the configured leakage or utility thresholds are flagged for manual review.\n", |
804 | 804 | "- `needs_human_review` is threshold-based, so a record can have small nonzero\n", |
805 | 805 | " leakage without being flagged.\n", |
806 | 806 | "- Use this to prioritize human attention on the records that need it most.\n", |
|
891 | 891 | "Call `evaluate()` to run LLM-as-judge scoring on the rewrite result — detection validity and three quality rubrics (privacy, quality, style).\n", |
892 | 892 | "Evaluation makes additional LLM calls per record. For larger datasets, evaluate\n", |
893 | 893 | "a preview first; this tutorial evaluates all 25 rows to demonstrate the complete workflow.\n", |
894 | | - "This holistic judge is independent of pipeline leakage scoring, so their assessments may differ.\n", |
| 894 | + "The holistic privacy rubric and pipeline leakage metric are independent, so they may disagree.\n", |
895 | 895 | "See [Evaluation](../../concepts/evaluation/#rewrite-evaluation) for details." |
896 | 896 | ] |
897 | 897 | }, |
|
0 commit comments