Skip to content

refactor(kvcache): fold prefix matching into one accumulator - #2669

Draft
nilig wants to merge 1 commit into
llm-d:mainfrom
nilig:perf/prefix-matcher-a
Draft

refactor(kvcache): fold prefix matching into one accumulator#2669
nilig wants to merge 1 commit into
llm-d:mainfrom
nilig:perf/prefix-matcher-a

Commits

Commits on Sep 2, 2026