Search results

i have hard prompt and creative writing score, how to caculate a single score for arena-hard-v2? like qwen

Status: Open.

#91 In lmarena/arena-hard-auto;

· jammyWolf opened on Dec 22, 2025

Hi ! How can i add my new model to lmarena ?

Status: Open.

#89 In lmarena/arena-hard-auto;

· hl0737 opened on Oct 31, 2025

Different Results from ReadMe

Status: Open.

#85 In lmarena/arena-hard-auto;

· Zhichao-Jimmy970201 opened on Sep 12, 2025

Having a single baseline is kinda wrong?

Status: Open.

#84 In lmarena/arena-hard-auto;

· TsenreD opened on Aug 7, 2025

Bootstrapping choice

Status: Open.

#83 In lmarena/arena-hard-auto;

· TsenreD opened on Aug 4, 2025

So confused by the pairwise baselines

Status: Open.

#82 In lmarena/arena-hard-auto;

· teknium1 opened on Jul 24, 2025

The speed is slow and the bar is invalid when I use vllm

Status: Open.

#81 In lmarena/arena-hard-auto;

· yhzhang067 opened on Jul 14, 2025

Questions about the Evaluate Benchmarks

Status: Open.

#80 In lmarena/arena-hard-auto;

· Eldo-rado opened on Jul 14, 2025

The score using Gemini-2.5 as the Judger cannot be aligned

Status: Open.

#77 In lmarena/arena-hard-auto;

· QuanWanLear opened on Jun 18, 2025

Can not finish generate answers with local Llama-3.1-8B-Instruct model with vllm serving

Status: Open.

#74 In lmarena/arena-hard-auto;

· jltchiu opened on Jun 2, 2025

Add Deepseek-R1-0528 Models to Leaderboard

Status: Open.

#73 In lmarena/arena-hard-auto;

· Minami-su opened on Jun 1, 2025

What’s the cost of using Arena-Hard-v2.0-Preview with gpt-4.1 and Gemini-2.5 as the judge models?

Status: Open.

#72 In lmarena/arena-hard-auto;

· ZeguanXiao opened on May 29, 2025