|
| 1 | +# task332_qwen_all_sft_structured_split_policy_remediation_s1 - Structured rows and split-policy remediation |
| 2 | + |
| 3 | +<!-- METADATA:STATUS=InProgress,ASSIGNEE=intern_nemotron_worker_4,SESSION=1 --> |
| 4 | + |
| 5 | +## Background |
| 6 | + |
| 7 | +task329/#392 and task330/#393 are merged as partial evidence closeout. The raw |
| 8 | +pass expansion is still blocked by two non-SWE issues: |
| 9 | + |
| 10 | +- `instruction-following-structured` has 6 validation-filtered rows in task329 |
| 11 | + packing receipts. |
| 12 | +- valid/test exposure is sparse: train exposes all three raw pass sources, but |
| 13 | + valid/test expose only `task322-agentic-interactive`. |
| 14 | + |
| 15 | +These must be remediated or explicitly accepted before any expanded all-SFT |
| 16 | +packed contract can be considered. |
| 17 | + |
| 18 | +## Goal |
| 19 | + |
| 20 | +Produce a no-training remediation report and task-owned evidence for the |
| 21 | +structured filtered rows and per-source split exposure policy. The output should |
| 22 | +state whether the raw-pass sources are ready for a later combined packed |
| 23 | +contract after task331 SWE remediation, or fail closed with exact blockers. |
| 24 | + |
| 25 | +## Required Inputs |
| 26 | + |
| 27 | +- Current `origin/main`: `410c2247fc5e09e6ad831bdee1628830b97fbd89`. |
| 28 | +- task322/#388 raw source evidence for `instruction-following-structured` and |
| 29 | + `agentic-interactive`. |
| 30 | +- task329/#392 evidence root: |
| 31 | + `/work-agents/intern_nemotron_worker_2/outputs/task329_qwen_all_sft_raw_pass_split_pack_proof_s1/run_20260604T053349Z`. |
| 32 | +- Merged task330/#393 review report: |
| 33 | + `workspace/tasks/task330_qwen_all_sft_task329_independent_review_s1/task329_independent_review_report.md`. |
| 34 | +- Qwen3-30B model/tokenizer path: |
| 35 | + `/mnt/cephfs/data/stable/models/Qwen/Qwen3-30B-A3B-Instruct-2507`. |
| 36 | + |
| 37 | +## Scope |
| 38 | + |
| 39 | +- Branch: |
| 40 | + `intern_nemotron_worker_4/task332_qwen_all_sft_structured_split_policy_remediation_s1`. |
| 41 | +- Build a task-owned output root under |
| 42 | + `/work-agents/intern_nemotron_worker_4/outputs/task332_qwen_all_sft_structured_split_policy_remediation_s1/`. |
| 43 | +- Identify the exact 6 `instruction-following-structured` filtered rows, row |
| 44 | + ids, validation errors, source checksums, and whether they can be fixed or |
| 45 | + should be excluded by a lead-visible policy. |
| 46 | +- Define a deterministic per-source train/valid/test exposure policy for the |
| 47 | + raw pass sources, with minimum valid/test exposure or an exact sparse-exposure |
| 48 | + acceptance proposal. |
| 49 | +- Produce intended-vs-exposed manifests and checksums. If a no-training repack |
| 50 | + is feasible without task331 SWE remediation, include it; otherwise state the |
| 51 | + exact dependency on task331. |
| 52 | +- Preserve decontam proof and no AIME2025 prompt/label train rows. |
| 53 | + |
| 54 | +## Expected Output |
| 55 | + |
| 56 | +- Report: |
| 57 | + `workspace/tasks/task332_qwen_all_sft_structured_split_policy_remediation_s1/structured_split_policy_report.md` |
| 58 | +- Worker branch and PR to `main` for docs/status plus any scoped helper/config |
| 59 | + changes. |
| 60 | +- Mailbox closeout with: |
| 61 | + - branch/head/PR, |
| 62 | + - commands and environment, |
| 63 | + - output root and checksums, |
| 64 | + - filtered-row disposition, |
| 65 | + - split-policy disposition, |
| 66 | + - exact dependency on task331 or next combined-contract task. |
| 67 | + |
| 68 | +## Boundaries |
| 69 | + |
| 70 | +- No training, optimizer steps, benchmark eval, export, endpoint, promotion, |
| 71 | + merge, self-merge, or main push. |
| 72 | +- No task255 reuse. |
| 73 | +- No AIME2025 prompts or labels as training rows. |
| 74 | +- No shared deletion or mutation, especially under |
| 75 | + `/mnt/cephfs/data/processing/lei.song`. |
| 76 | +- Do not modify task329 artifacts in place; write task332-owned outputs. |
| 77 | + |
| 78 | +## Acceptance Criteria |
| 79 | + |
| 80 | +- `PASS_SPLIT_POLICY_READY_WITH_SWE_PENDING`: structured filtered rows are |
| 81 | + remediated or explicitly excluded, per-source split policy is deterministic |
| 82 | + and evidenced, and only task331 SWE supervised-token remediation remains. |
| 83 | +- `REQUEST_CHANGES`: evidence is incomplete, inconsistent, or missing required |
| 84 | + checks. |
| 85 | +- `BLOCK_SPLIT_POLICY`: filtered rows or valid/test exposure cannot be safely |
| 86 | + remediated under current data/config. |
| 87 | + |
| 88 | +## Assignment |
| 89 | + |
| 90 | +- Team: `nemotron` |
| 91 | +- Team lead: `intern_nemotron_lead` |
| 92 | +- Worker: `intern_nemotron_worker_4` |
| 93 | +- Gate state: task310 training/eval/export/endpoint/promotion remain HOLD. |
0 commit comments