Commit b3b75cf
fix(compiler): default cluster_dims=(1,1,1) for backends that omit it
Backends without cluster launch support (e.g. hcu, mthreads) do not emit
cluster_dims in the compiled-kernel metadata JSON, so the KernelMetadata
namedtuple built here lacks that field. torch._inductor reads
kernel.metadata.cluster_dims unconditionally when a kernel carries metadata,
raising AttributeError during KV-cache profiling warmup (vllm 0.24.0 on
Hygon DTK 26.04). Default it to (1,1,1) — the same value vendor triton and
the iluvatar overlay already use — instead of patching torch/inductor per
backend in each vendor adapter.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>1 parent 52678a8 commit b3b75cf
1 file changed
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
434 | 434 | | |
435 | 435 | | |
436 | 436 | | |
437 | | - | |
| 437 | + | |
| 438 | + | |
| 439 | + | |
| 440 | + | |
| 441 | + | |
438 | 442 | | |
439 | 443 | | |
440 | 444 | | |
| |||
0 commit comments