feat: v1/messages support, part 3 (server endpoints): add v1/messages endpoints to NeMo server - #2284
Open
RobGeada wants to merge 3 commits into
Open
Conversation
Add an optional reasoning field to the ChatMessage dataclass so reasoning content survives round-tripping through to_dict/from_dict, and extract it from OpenAI-compatible responses via the 'reasoning' key in addition to 'reasoning_content'. Signed-off-by: Rob Geada <rob@geada.net>
Contributor
PR merge guidance@RobGeada thanks for the PR. GitHub is currently blocking merge for one or more repository requirements:
Relevant guide: |
Signed-off-by: Rob Geada <rob@geada.net>
Add /v1/messages and a checks endpoint that accept Anthropic Messages API format requests, with request/response schemas and SSE streaming that emits tool_use blocks. Stream tool calls through the handler in _stream_llm_call so the SSE formatter can surface them. Add the optional anthropic dependency to the server, all, and test_integration extras, since the server schemas depend on the anthropic SDK types. Document the endpoints: add an "Anthropic Messages" server guide page, add both endpoints to the OpenAPI spec (fern/openapi.yml) and the docs navigation and API reference layout. Signed-off-by: Rob Geada <rob@geada.net>
RobGeada
force-pushed
the
feat/anthropic-server-endpoints
branch
from
August 21, 2026 08:46
3a47ddd to
778f511
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds v1/messages support to the NeMo Guardrails server, as well as a v1/messages/checks endpoint, where /v1/messages is to /v1/messages/checks as /v1/chat/completions is to /v1/checks.
Note: Depends on:
Related Issue(s)
#2226
Verification
AI Assistance
Checklist