Description
It appears to not correctly determine the RAM and BW of an Arc Pro B70
And as such it is suggesting pretty large models that do not run well on this hardware:
Models quant Q8 are too much RAM consuming for the system.
whichllm --gpu "Arc Pro B70"
Error: Unknown GPU 'Arc Pro B70'. Did you mean: Arc Pro A40, Arc Pro A50, Arc Pro A60? Use --vram to specify VRAM in GB.
Steps to Reproduce
- Have an Interl Arc Pro B70 on Windows
- run whichllm
Hardware Info
CPU: AMD Ryzen 7 9700X
RAM: 64GB DDR5
GPU 0: NVIDIA GeForce RTX 4060 Ti — 16.0 GB (CC 8.9, CUDA 13.3) — BW: 288 GB/s
GPU 1: Intel(R) Arc(TM) Pro B70 Graphics — 31.8 GB (shared memory) — BW: N/A
Python Version
3.14.3
Operating System
Windows 11 25H2
whichllm Version
0.5.8
Description
It appears to not correctly determine the RAM and BW of an Arc Pro B70
And as such it is suggesting pretty large models that do not run well on this hardware:
Models quant Q8 are too much RAM consuming for the system.
Steps to Reproduce
Hardware Info
Python Version
3.14.3
Operating System
Windows 11 25H2
whichllm Version
0.5.8