Add verify-watermark-removal skill - #320
Conversation
…e key gives a scale rather than hiding the sample, generate warns instead of refusing on samples the mark missed, cost numbers are absent for not_our_text, the vendor-mark carry-over is an inference, the key is read without echo and kept out of the process under test, and the install pins a tag)
|
Thanks for the careful write-up — reviewed for security, prompt injection, and fit with this collection. Security / prompt injection: The skill markdown is clean (no override/exfil instructions). It only measures; it never removes a mark and refuses the “now undetectable” framing. Key handling is sensible ( Codebase fit: Frontmatter validates ( Merging. |
Summary
Adds
verify-watermark-removal, a skill that measures whether a "watermark remover" or "humanizer" actually removed a statistical text watermark, instead of repeating the tool's own claim.The check is possible because the mark is planted first, under a key the user holds. A detector that knows the key is the strongest detector that can exist for that text, so the score is a ceiling rather than a guess. The skill also reports what the rewrite cost: meaning kept, facts kept, longest verbatim run, share of words changed, length ratio.
It only measures. It removes nothing, and it never claims anything about a specific vendor's watermark.
Component Details
Testing
node scripts/validate-skills.jsandnode scripts/validate-all.js, both pass)generate,check,check --json,matrix) are the ones the tool ships, and the example output in the skill is the real output format ofunmark-checker checkExamples
mark_present,uncertainormark_gonewith the cost columns.unmark-checker matrixturns the folder into one table, and the services are compared on the same measurements.