AI Agent outputs raw JSON instead of executing tool calls

[Spit-ball]

Setup: Windows machine; Docker desktop; llama.cpp; AI Models attempted: Qwen and Mistral.

Problem: Anytime I ask the agent mode, for example, to add an event to my calendar, or make a note, or edit a document, it outputs JSON like in the attached screenshot. Sometimes, it will event give me an explanation of how the command works, but the AI does not actually execute the command.

[CoolJohn-lab]

Sounds like you might be using too small / dumb of a model for it to be able to execute tool calls. It's doing its best and generating the JSON, but it can't figure out how to call the MCP. Can I ask what quant / version of Qwen you have and what hardware you are running it on?