You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Support configuring multiple providers at once via [providers.*] in config.toml (e.g. chatgpt, openai, anthropic-compatible).
New anthropic-compatible provider type: forwards Anthropic Messages API requests directly to compatible backends by configuring base_url + api_key.
Structured model routing: use [models] + [models.routing], each key maps to { provider, model }.
Longest-prefix model routing: models.routing keys can be “family prefixes” (e.g. claude-haiku-4-5), automatically matching dated variants like claude-haiku-4-5-20251001.
Legacy single-provider format still supported: original [provider] + models.mapping is normalized internally into the same multi-provider structure.
Streaming & error handling
supports_streaming flag activated per provider: controls whether the adapter asks the backend for streaming responses; recommended false so the adapter simulates SSE uniformly.
Include full API URL in provider error messages (OpenAI / ChatGPT / Anthropic-compatible) to quickly diagnose 404 and path issues.
For Anthropic-compatible backends that return SSE while stream=false, parse failures now include the full raw body to aid debugging.
Thinking block support
Response type extended with thinking variant: MessagesResponse.content now supports type: "thinking" with thinking text and optional signature.
Anthropic-compatible JSON responses containing thinking blocks can be deserialized correctly, instead of failing on unknown variants.
When emitting SSE, thinking blocks are forwarded using Anthropic’s official SSE schema (content_block_start + thinking_delta + content_block_stop), not as plain text; UIs can hide or specially render thinking instead of showing it inline as <thinking>...</thinking>.
Docs & templates
Updated config-example.toml to showcase multi-provider configuration, supports_streaming, and prefix-based routing with detailed comments.
Updated README (EN / ZH-HANT / ZH-HANS) to document multi-provider architecture, models.routing resolution rules, Anthropic-compatible providers, and thinking block behavior.