Balance answer lengths to prevent longest-answer-is-correct pattern#584
Draft
Copilot wants to merge 4 commits into
Draft
Balance answer lengths to prevent longest-answer-is-correct pattern#584Copilot wants to merge 4 commits into
Copilot wants to merge 4 commits into
Conversation
… longest Fixed 77 questions across all categories where the correct answer was significantly longer than all incorrect answers (ratio≥1.3x, diff≥10 chars). Expanded incorrect answers with plausible detail to prevent length from giving away the correct answer. Agent-Logs-Url: https://github.com/FidelusAleksander/ghcertified/sessions/76dd7b3a-060e-4b84-9bcc-d7900fa3f692 Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Fix additional 20 questions where correct answer was moderately longer (ratio 1.2-1.35x). Expanded incorrect answers with plausible context to reduce the length-based tell pattern. Agent-Logs-Url: https://github.com/FidelusAleksander/ghcertified/sessions/76dd7b3a-060e-4b84-9bcc-d7900fa3f692 Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Co-authored-by: question-review agent Agent-Logs-Url: https://github.com/FidelusAleksander/ghcertified/sessions/76dd7b3a-060e-4b84-9bcc-d7900fa3f692 Co-authored-by: FidelusAleksander <63016446+FidelusAleksander@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Update question answers to equal length
Balance answer lengths to prevent longest-answer-is-correct pattern
Apr 20, 2026
Owner
|
I'll try to go through this in a few days see if it makes sense |
github-actions
Bot
added
actions
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The correct answer was uniquely the longest in 177/524 questions (34%), creating a test-taking shortcut that undermines learning.
Changes
foundations/question-026.md("setup" → "set up")Impact
Remaining 17 have minimal diffs (8–18 chars) where further expansion would make wrong answers unnaturally verbose.
Example
All 106 existing tests pass.
Warning
Firewall rules blocked me from connecting to one or more addresses (expand for details)
I tried to connect to the following addresses, but was blocked by firewall rules:
fonts.googleapis.com/opt/hostedtoolcache/node/24.14.1/x64/bin/node node /home/REDACTED/work/ghcertified/ghcertified/app/node_modules/.bin/next build(dns block)If you need me to access, download, or install something from one of these locations, you can either: