Skip to content

Add FTC-09 analyze-map dogfood report and artifacts#789

Merged
yuechen-li-dev merged 1 commit into
masterfrom
codex/analyze-nist-ftc-09-using-aetheris
Jun 23, 2026
Merged

Add FTC-09 analyze-map dogfood report and artifacts#789
yuechen-li-dev merged 1 commit into
masterfrom
codex/analyze-nist-ftc-09-using-aetheris

Conversation

@yuechen-li-dev

Copy link
Copy Markdown
Owner

Motivation

  • Dogfood the analyze map workflow on a realistic NIST STEP model (FTC-09) to evaluate its utility for LLM-oriented spatial reasoning and capture lessons for next features.
  • Produce a concise LLM-facing report and lightweight artifacts that demonstrate current strengths/weaknesses of six-view summaries and point probes.

Description

  • Add a dogfood report at docs/reports/analyze-map-dogfood-ftc09-a0.md that documents commands run, findings, schema suggestions, and a recommended next milestone (ANALYZE-MAP-A5).
  • Save representative six-view and probe outputs under docs/reports/artifacts/analyze-map-ftc09/ as ftc09-six-view-16x16.json, ftc09-six-view-32x32.json, and ftc09-point-probes.json (sizes ~66 KiB, ~74 KiB, ~25 KiB respectively).
  • Use the real vendored STEP file path testdata/step242/nist/FTC/nist_ftc_09_asme1_ap242-e1.stp for all runs and make no behavioural changes to the codebase (report + artifacts only).
  • Summarize key observations in the report: six-view summaries are a useful coarse measurement primitive (hit coverage, height bands, surface-family counts, analytic provenance), but they lack connected-component grouping, suggested probe points, face-id/surface-family grids, and adaptive refinement needed to make holes/slots/cutouts explicit to an LLM.

Testing

  • Ran dotnet restore Aetheris.slnx and dotnet build Aetheris.slnx -f net10.0 --no-restore /m:1 which completed successfully (build warnings only).
  • Executed dotnet test Aetheris.CLI.Tests/Aetheris.CLI.Tests.csproj -f net10.0 --filter "AnalyzeMap|SixView|Llm|Compact" which passed (4 tests passed).
  • Ran the dogfood commands aetheris analyze map on FTC-09 with --views six --resolution 16x16 --llm --json and --views six --resolution 32x32 --llm --json, which completed successfully (approx 124s for 16x16 and 303s for 32x32 in this environment) and produced the saved artifacts, and ran a point probe with --plane xy --direction -z --point 0,0 --json which produced multi-hit analytic ray details.
  • Verified dotnet run --project Aetheris.CLI -- --help and basic CLI health; no crashes or timeouts were observed for the required runs.

Codex Task

@yuechen-li-dev yuechen-li-dev merged commit 4343d05 into master Jun 23, 2026
2 checks passed
@yuechen-li-dev yuechen-li-dev deleted the codex/analyze-nist-ftc-09-using-aetheris branch June 23, 2026 07:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant