为什么在请求参数中添加"format"后，就跳过了什么调用tool的推理？

[Chaiyym]

ollama+qwen2.5:7b-instruct

1.请求参数中不带format,会返回tool_calls

//请求参数中不带format
POST http://127.0.0.1:11434/api/chat
Content-Type: application/json

{
  "model": "qwen2.5:7b-instruct",
  "stream": false,
  "messages": [{"role": "user","content": "获取当前时间"}],
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "getCurrentTime",
        "description": "获取当前时间"
      }
    }
  ],
  "options": {}
}

//返回结果，有tool_calls
{
  "model": "qwen2.5:7b-instruct",
  "created_at": "2025-03-20T10:03:51.849880589Z",
  "message": {
    "role": "assistant",
    "content": "",
    "tool_calls": [
      {
        "function": {
          "name": "getCurrentTime",
          "arguments": {}
        }
      }
    ]
  },
  "done_reason": "stop",
  "done": true,
  "total_duration": 2803019805,
  "load_duration": 19665381,
  "prompt_eval_count": 143,
  "prompt_eval_duration": 177000000,
  "eval_count": 16,
  "eval_duration": 2597000000
}

2.请求参数中带format,不会返回tool_calls

//请求参数中带format
POST http://127.0.0.1:11434/api/chat
Content-Type: application/json

{
  "model": "qwen2.5:7b-instruct",
  "stream": false,
  "messages": [{"role": "user","content": "获取当前时间"}],
  "format": {"type": "object", "properties": {"time_value": {"type": "string", "description": "当前时间"}}},
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "getCurrentTime",
        "description": "获取当前时间"
      }
    }
  ],
  "options": {}
}

//返回结果，没有tool_calls
{
  "model": "qwen2.5:7b-instruct",
  "created_at": "2025-03-20T10:12:30.855320447Z",
  "message": {
    "role": "assistant",
    "content": "{\n    \"time_value\": \"2023-10-18T19:46:53Z\"\n}\n"
  },
  "done_reason": "stop",
  "done": true,
  "total_duration": 5478053203,
  "load_duration": 19145209,
  "prompt_eval_count": 143,
  "prompt_eval_duration": 177000000,
  "eval_count": 30,
  "eval_duration": 5273000000
}

[jklj077]

tool call的自动解析是靠识别生成内容中的"<tool_call>"和"</tool_call>"两个special token。https://qwen.readthedocs.io/zh-cn/latest/framework/function_call.html#qwen2-5-function-calling-templates

强制输出JSON，那就生成不了"<tool_call>"和"</tool_call>"了，自然也没法自动解析了。

都强制输出JSON了，直接JSON parse content好了。