[Feature Request]: Enqueued compaction #879
smheidrich
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Component
CLI
Problem statement
The already-implemented ability to enqueue messages is really useful, but as model intelligence and speed tend to degrade with increasing context lengths, it's common for enqueued tasks to be implemented carelessly or very slowly because the model was already near the end of the context window by the time it got the follow-up task.
Proposed solution
It would be great if it was possible to enqueue a
/compactinstruction and then enqueue the actual message containing the task after that.Additional context
No response
Beta Was this translation helpful? Give feedback.
All reactions