| description | Shrink your LLM context. |
|---|
Context-guru is a Rossoctl Cortex plugin that compacts an agent's growing tool-output context before it reaches the LLM, so a task whose raw context exceeds the model's window still fits — and the agent gets the right answer because of the compaction.
Same agent, same model, same window. The only variable is context-guru:
| mode | context-guru | request the model sees | agent answer |
|---|---|---|---|
| off | disabled (kill-switch) | raw ~18K tok → truncated to the 12K window | ❌ misses the anomaly, hallucinates a wrong refund |
| observe | shadow (measures, doesn't apply) | raw ~18K tok (truncated); logs it would save 52KB→30KB | ❌ same wrong answer — proves the measurement is free |
| enforce | applied | compacted ~10K tok → fits | ✅ finds the TX4827 duplicate, clears the others |
context-guru is an in-process AuthBridge plugin (not a sidecar service). The
agent's outbound LLM calls are routed through AuthBridge's forward proxy
(HTTP_PROXY=:8081); the plugin runs in the outbound pipeline and rewrites
the request body before it leaves the pod.
