Skip to content

Remove n300-llmbox from perf benchmarks#5436

Open
vkovacevicTT wants to merge 9 commits into
mainfrom
vkovacevic/remove-n300-llmbox
Open

Remove n300-llmbox from perf benchmarks#5436
vkovacevicTT wants to merge 9 commits into
mainfrom
vkovacevic/remove-n300-llmbox

Conversation

@vkovacevicTT

@vkovacevicTT vkovacevicTT commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

Ticket

Closes #4949

Problem description

We have successfully enabled benchmarks on qb2-blackhole.
n300-llmbox runners produce very long queue times and should be deprecated.

What's changed

Checklist

@vvukomanTT

Copy link
Copy Markdown
Contributor

Great, this will help reduce queue times massively!
One note, let's remove all references for n300-llmbox tests then

{ "runs-on": "n300-llmbox", "filter": ["test_llama_3_1_70b_tp"] } ]'
also has some, maybe in other places too.

@nsumrakTT nsumrakTT left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love this PR!
Thank you!

@codecov-commenter

codecov-commenter commented Jun 30, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 33.85%. Comparing base (b621dab) to head (72df121).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5436   +/-   ##
=======================================
  Coverage   33.85%   33.85%           
=======================================
  Files          37       37           
  Lines        4989     4989           
=======================================
  Hits         1689     1689           
  Misses       3300     3300           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

@vkovacevicTT vkovacevicTT force-pushed the vkovacevic/remove-n300-llmbox branch from 04c1350 to d069b5d Compare June 30, 2026 16:16
@vkovacevicTT vkovacevicTT force-pushed the vkovacevic/remove-n300-llmbox branch from d069b5d to 7fde2a6 Compare June 30, 2026 20:36
@vkovacevicTT vkovacevicTT force-pushed the vkovacevic/remove-n300-llmbox branch from 7fde2a6 to b183ce1 Compare July 1, 2026 10:52
@vkovacevicTT vkovacevicTT force-pushed the vkovacevic/remove-n300-llmbox branch from b183ce1 to 72df121 Compare July 1, 2026 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

On Nightly lasts too long because of perf benchmark

6 participants