Skip to content

Commit 4c22cf1

Browse files
author
ZhiweiYan-96
committed
[DeepSeek R1]Use UNIFORM QueryLen MLA for MTP
1 parent f23e28b commit 4c22cf1

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

vllm/v1/attention/backends/mla/rocm_aiter_mla.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ class AiterMLAMetadataBuilder(MLACommonMetadataBuilder[AiterMLAMetadata]):
8181
# TODO(luka, lucas): audit this as part of:
8282
# https://github.com/vllm-project/vllm/issues/22945
8383
cudagraph_support: ClassVar[AttentionCGSupport] = AttentionCGSupport.UNIFORM_BATCH
84-
query_len_support: ClassVar[QueryLenSupport] = QueryLenSupport.VARLEN
84+
query_len_support: ClassVar[QueryLenSupport] = QueryLenSupport.UNIFORM
8585

8686
def __init__(
8787
self,

0 commit comments

Comments
 (0)