Skip to content

Publish pinned Lean evaluation images - #776

Merged
morluto merged 5 commits into
mainfrom
codex/lean-verifier-replay-764
Aug 7, 2026
Merged

Publish pinned Lean evaluation images#776
morluto merged 5 commits into
mainfrom
codex/lean-verifier-replay-764

Conversation

@morluto

@morluto morluto commented Aug 7, 2026

Copy link
Copy Markdown
Owner

Summary

Adds two reusable OCI runtimes for Harbor evaluations:

  • jacobian-lean-checker contains the pinned Lean compiler and verifier dependencies for independent source replay.
  • jacobian-lean-repl-agent contains the pinned Lean REPL provider runtime for agent and feasibility environments.

They are intentionally separate: a successful REPL trace is diagnostic telemetry, while a checker must replay a submitted artifact.

A trusted main-only workflow publishes both to GHCR, records an immutable digest and unpacked-size receipt, and requests SBOM and provenance attestations. PRs build both images without publishing. The evaluation docs now define digest pinning, the authority boundary, and the need to measure Harbor writable storage separately from image layers.

This is the publication foundation for #764. A follow-up will consume the published checker digest in the Lean Harbor task and replace report-only acceptance with proof-source replay.

Validation

  • uv run pre-commit run actionlint --files .github/workflows/lean-images.yml — passed
  • make docs-linkcheck — passed
  • make check-static — blocked by an existing formatting failure in tests/unit/tooling/test_eval_telemetry.py on origin/main
  • Local Docker build — blocked because this host could not reach Docker Hub for the digest-pinned Python parent image; the new PR build matrix exercises that exact build and records its size.

Review order

  1. containers/lean-checker/Dockerfile and containers/lean-repl-agent/Dockerfile
  2. .github/workflows/lean-images.yml
  3. Evaluation-contract documentation

@cursor

cursor Bot commented Aug 7, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: dd0fd996d2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .github/workflows/lean-images.yml Outdated
Comment thread .github/workflows/lean-images.yml
@morluto
morluto merged commit ae6cffe into main Aug 7, 2026
48 checks passed
@morluto
morluto deleted the codex/lean-verifier-replay-764 branch August 7, 2026 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant