Skip to content

docs(cli): CLI-005 harness-expansion spike — evaluation + proposed D-045#126

Merged
joshuaboys merged 1 commit into
mainfrom
docs/cli-005-harness-spike
Jul 23, 2026
Merged

docs(cli): CLI-005 harness-expansion spike — evaluation + proposed D-045#126
joshuaboys merged 1 commit into
mainfrom
docs/cli-005-harness-spike

Conversation

@joshuaboys

@joshuaboys joshuaboys commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Summary

CLI-005 (harness-expansion research spike). Evaluates candidate AI-coding
harnesses against the D-040 native-discovery gate — a harness is a zero-asset
add (like Grok) iff it both natively reads AGENTS.md and auto-discovers
.agents/skills/<name>/SKILL.md. Deliverable:
plans/research/2026-07-23-harness-expansion-spike.md.

Four parallel research streams with primary-source citations; the load-bearing
GO claims were spot-checked directly (Antigravity's .agents/skills default;
Amp + Windsurf skills discovery; the agents.md registry for AGENTS.md adoption).

Verdicts

Verdict Harnesses
GO (zero-asset) Antigravity, Amp, Gemini CLI, Windsurf, Roo Code¹, OpenClaw²
GO-WITH-ASSETS Cursor³ (low), Hermes⁴
NO-GO / defer Aider, Zed, Devin, Jules, Warp, Continue, Factory, Junie, goose

¹ AGENTS.md auto-load is a toggle · ² confirm hands-on before commit ·
³ reads AGENTS.md but per-tool skills dir; mirror cost is low & user base large ·
⁴ global ~/.hermes/skills/ path + severe name collision → deprioritise.

Proposed D-045 (needs your sign-off)

  1. Add as zero-asset (CLI-006): Antigravity, Amp, Gemini CLI, Windsurf, Roo Code
  2. Add after a 5-min hands-on confirm: OpenClaw
  3. Separate GO-WITH-ASSETS decision: Cursor (low cost, large user base)
  4. Deprioritise: Hermes · Not now: the AGENTS.md-only crowd

The spike does not self-authorise the set — D-045 is recorded as proposed.

Test plan

  • aps lint plans/ clean (45 APS files); markdownlint clean on both files
  • Flagship GO claims independently verified from primary vendor docs
    (antigravity.google/docs/skills, ampcode.com/manual, docs.devin.ai Cascade
    skills, agents.md registry)
  • Recommendation marked proposed; every harness still gets a binding
    aps init --tools <x> smoke test in CLI-006 (Grok precedent, CLI-004)

APS Work Items

  • CLI-005 → spike complete; evaluation linked from the module; D-045 proposed.
  • Module stays Draft; CLI-006 (implement approved harnesses) unblocks once
    you approve the D-045 set.

Notes

Key nuance recorded in the doc: "zero-asset" bounds bespoke scaffold cost
only — each add still costs a tool key across Rust/bash/pwsh, wizard/install
dispatch, docs, and D-039 parity fixtures. Recommend the curated set, not
"everything that passes."

Tests candidate harnesses against the D-040 native-discovery gate (reads
AGENTS.md AND auto-discovers .agents/skills/<name>/SKILL.md → zero-asset add
like Grok). Four parallel research streams with primary-source citations;
flagship claims spot-checked directly by the author (Antigravity .agents/skills
default; Amp + Windsurf .agents/skills discovery; agents.md registry).

Findings:
- Zero-asset GO: Antigravity, Amp, Gemini CLI, Windsurf, Roo Code (toggle
  caveat), and OpenClaw (confirm hands-on).
- GO-WITH-ASSETS: Cursor (per-tool skills dir; low mirror cost, large user
  base) and Hermes (global ~/.hermes/skills path + severe name collision).
- NO-GO/defer: the AGENTS.md-only crowd (Aider, Zed, Devin, Jules, Warp,
  Continue, Factory, Junie, goose) — no shared .agents/skills discovery yet.

Records the recommendation in D-045 as PROPOSED, pending sign-off — the spike
does not self-authorise the harness set. Notes that "zero-asset" bounds bespoke
scaffold cost only; each add still carries per-tool plumbing + D-039 parity +
a real init smoke test in CLI-006.

APS: CLI-005

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01B8Leerbi6hYu73bp6G6Gag
@joshuaboys
joshuaboys merged commit dfb134d into main Jul 23, 2026
13 checks passed
@joshuaboys
joshuaboys deleted the docs/cli-005-harness-spike branch July 23, 2026 05:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant