Skip to content

Commit 1c63fb0

Browse files
committed
disable vulkan sdpa for persistent kv cache
1 parent 6f0a47f commit 1c63fb0

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/layer/vulkan/sdpa_vulkan.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ int SDPA_vulkan::load_param(const ParamDict& pd)
4848
{
4949
int ret = SDPA::load_param(pd);
5050

51-
if (int8_scale_term)
51+
if (int8_scale_term || kv_cache == 2)
5252
{
5353
support_vulkan = false;
5454
}

0 commit comments

Comments
 (0)