Skip to content

Clarify finite partition verification scope - #918

Merged
morluto merged 2 commits into
mainfrom
agent/clarify-finite-partition-scope
Aug 9, 2026
Merged

Clarify finite partition verification scope#918
morluto merged 2 commits into
mainfrom
agent/clarify-finite-partition-scope

Conversation

@yuelgrace1810-ops

Copy link
Copy Markdown
Collaborator

Summary

  • clarify that case.partition.finite treats universe members and case labels as opaque caller-supplied strings
  • state in verified results that the checker replays only equality-based coverage and disjointness inside the supplied universe
  • keep external-domain completeness and member/case semantics explicitly outside the verification record
  • add a focused regression test for the model-visible contract and result wording

Closes #914.

Root cause

A held-out weak-model evaluation correctly used the finite partition checker but promoted its verification record to the entire mathematical answer. The record established coverage and disjointness of a caller-constructed string universe; it did not establish that the universe was mathematically exhaustive or that its strings and case labels had the claimed semantics.

The checker, artifact bindings, and assurance decision were correct. The missing piece was a sufficiently explicit statement of that semantic boundary in the operation card and the successful result.

Trust and compatibility

This does not change the checker, verification record, accepted inputs, output schema, or VERIFIED eligibility. It changes descriptive model-visible text only.

Validation

  • focused finite-partition suite: 6 passed
  • make check: Ruff, formatting, complexity, mypy, 869 unit tests passed
  • composition suite: 476 passed, 2 skipped (pinned Lean runtime unavailable)
  • MCP suite: 45 passed; one localhost-binding test was blocked by the sandbox and passed separately with localhost permission
  • git diff --check: passed

@morluto
morluto marked this pull request as ready for review August 9, 2026 08:37

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 potential issue.

Open in Devin Review

Comment thread src/jacobian/finite_partition.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 888065a6a9

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/jacobian/finite_partition.py Outdated
@morluto
morluto force-pushed the agent/clarify-finite-partition-scope branch from 888065a to 8894880 Compare August 9, 2026 08:54
@morluto
morluto merged commit 938cc5a into main Aug 9, 2026
39 checks passed
@morluto
morluto deleted the agent/clarify-finite-partition-scope branch August 9, 2026 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Evaluation]: finite-partition verification can be promoted beyond the supplied universe

2 participants