Skip to content

Add orca-replay skill - #322

Closed
xizhuomengcontin wants to merge 1 commit into
davepoon:mainfrom
xizhuomengcontin:orcareplay-skill
Closed

xizhuomengcontin wants to merge 1 commit into
davepoon:mainfrom
xizhuomengcontin:orcareplay-skill

Conversation

@xizhuomengcontin

Copy link
Copy Markdown
Contributor

Adds one skill at plugins/all-skills/skills/orca-replay/SKILL.md, in the structure
CONTRIBUTING specifies (name / category / description front matter, then When to Use → What
This Skill Does → How to Use → Example → Tips).

What it is

A skill that stops the agent answering questions about its own past from memory. When someone asks
"why did you overwrite that file" or "which step broke the build", it reads the recording of the
run — tool calls with their arguments, shell exit codes, the files that changed — and answers from
that instead of reconstructing a plausible story.

The part I care most about: the trace labels every causal edge recorded or inferred, and the
skill requires the agent to carry that distinction into its answer. "The trace shows the rm at
step 14 removed it"
and "this looks like the rm at step 14, going by timing" are different
claims, and flattening them into one confident sentence is the failure the skill exists to prevent.

Two things you should know before merging

It depends on an external tool. The skill needs the orcareplay npm package (Node 20+) with
its MCP server registered as orca, plus at least one recorded run in the project. I have put that
in a Requirements section at the end rather than burying it, and the skill's own instruction
when no recording exists is to say so and offer to start one — not to fall back to guessing. If
your marketplace would rather not carry skills that require an outside install, that is a fair
line and I will withdraw this.

It is a copy, and copies go stale. The canonical skill lives at
skills/orca-replay/SKILL.md
in our repo. This version is condensed to your format; the upstream one is longer, mostly because
it spells out replay's destructive cases at more length. I am happy to keep this in sync, and
happier still if you would rather point at the source than vendor it.

Checked: orca-replay does not overlap an existing skill in plugins/all-skills/skills/, one
purpose per contribution, Apache-2.0.

@davepoon

Copy link
Copy Markdown
Owner

Thanks for sending this over — the recorded-vs-inferred distinction is a good rule, and the replay warnings (worktree, no sandbox, matching replay ≠ determinism) are honest.

Reviewed for security, prompt injection, and fit with this collection.

Security / prompt injection: No classic malice in the skill text. Requiring the agent to answer from the trace instead of memory is instruction, not injection. The filesystem-overwrite risk on orca_replay without worktree: true is documented clearly.

Codebase fit — blocking:

  1. Invalid skill categorycategory: development is not in the skill enum. Skills in plugins/all-skills/ must use one of the values in scripts/skill-schema.json (for this one, development-code is the match). Validation will fail as written, same bar as other category mismatches.

The external orcareplay MCP requirement is fine to keep if it stays in a Requirements section (other skills here depend on an outside install). Happy to re-review a follow-up with category: development-code.

Appreciate the contribution — closing for now so it’s clear this needs another pass. Please open a fresh PR (or reopen after fixing) once the category is valid.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants