Skip to content

[Feature]: #737

Description

@chenqi123

🚀 The feature, motivation and pitch

是否有对某个/某些请求的单独清理kv cache的运维措施,能否增加。 情况如下: 目前发现可能有这个问题 ,某些kv cache是异常数据,需要单独刷新这些kv cache ,否则基本上每次都异常了,但又想完全重新刷所有kv cache , 并且只知道一些请求的 message body 。

Alternatives

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions