Skip to content

Commit 8c07b04

Browse files
authored
improve impact report: simplified summary table (#39543)
1 parent eb3cec7 commit 8c07b04

2 files changed

Lines changed: 28 additions & 6 deletions

File tree

.github/workflows/objective-impact-report.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/objective-impact-report.md

Lines changed: 27 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -202,15 +202,16 @@ The report must include:
202202

203203
### Executive Summary
204204

205-
Write 2–4 sentences that directly answer: *What did we work on, what was the highest-impact work, which workflows contributed most to that impact, and how efficiently were AIC tokens spent?* Highlight the most impactful objective categories, the workflows contributing the most value, and any significant gaps (e.g., large AIC spend with no mapped objective value).
205+
Write 2–4 sentences that directly answer: *What did the agent work on, what was the highest-impact agentic work, which workflows contributed most to that impact, how efficiently were AIC tokens spent, and what high-impact work was delivered outside agentic workflows (if any)?* Highlight the most impactful objective categories, the workflows contributing the most value, and any significant gaps (e.g., large AIC spend with no mapped objective value).
206206

207207
### Summary
208208

209-
| Metric | PRs | Safe-output Issues | Combined |
210-
|---|---:|---:|---:|
209+
| Metric | Value |
210+
|---|---:|
211211

212-
Include:
212+
When a metric includes sub-counts, format the Value as `merged: X, closed: Y, open excluded: Z`.
213213

214+
Include:
214215
- PRs analyzed with linked issue (merged / closed / excluded open)
215216
- PRs excluded (no linked closing issue)
216217
- Safe output outcomes analyzed
@@ -221,7 +222,7 @@ Include:
221222
- AI Credits
222223
- Impact Efficiency
223224

224-
### What We Worked On
225+
### Agentic Work by Objective
225226

226227
Group all **accepted, mapped** outcomes by objective category (the highest-value objective label from the mapping). For each category, list:
227228

@@ -299,6 +300,27 @@ State whether AI Credits came from deterministic precomputed data or from a live
299300

300301
If AI Credits are unavailable, still produce the delivered-value analysis and clearly state that the cost-normalized Impact Efficiency metric could not be computed.
301302

303+
### Human Work
304+
305+
This section is independent of AIC and the agentic efficiency analysis above. It captures pull requests merged in the analysis window that could not be attributed to any GitHub Agentic Workflow run in the deterministic logs.
306+
307+
Identify merged PRs from `/tmp/gh-aw/agent/objective-impact-report/merged-prs-linked.json` that have **no** matching run in `/tmp/gh-aw/agent/objective-impact-report/workflow-logs.json` (i.e., PRs whose author or head branch cannot be linked to any workflow run that produced an outcome). Treat these as human-authored contributions for reporting, but explicitly note that missing log coverage or attribution gaps can inflate this count.
308+
309+
For each human-authored merged PR that has a linked closing issue, resolve objective labels from that root issue using the same objective mapping. Group results by objective category and report:
310+
311+
- Objective category name and its mapping value
312+
- Number of human-authored merged PRs in this category
313+
- Total objective value contributed
314+
- Representative examples (up to 3 linked PRs)
315+
316+
Also report:
317+
318+
- Total number of human-authored merged PRs identified in the analysis window
319+
- Number with a linked closing issue vs. without
320+
- Number mapped to an objective vs. unmapped
321+
322+
Sort categories by total objective value descending. Do **not** compute AIC or Impact Efficiency for this section — human work has no associated AI Credits cost.
323+
302324
## Safe output
303325

304326
Use only `close-issue` and `create-issue`.

0 commit comments

Comments
 (0)