Skip to content

feat: v1/messages support, part 3 (server endpoints): add v1/messages endpoints to NeMo server - #2284

Open
RobGeada wants to merge 3 commits into
NVIDIA-NeMo:developfrom
RobGeada:feat/anthropic-server-endpoints
Open

feat: v1/messages support, part 3 (server endpoints): add v1/messages endpoints to NeMo server#2284
RobGeada wants to merge 3 commits into
NVIDIA-NeMo:developfrom
RobGeada:feat/anthropic-server-endpoints

Conversation

@RobGeada

Copy link
Copy Markdown
Contributor

Description

Adds v1/messages support to the NeMo Guardrails server, as well as a v1/messages/checks endpoint, where /v1/messages is to /v1/messages/checks as /v1/chat/completions is to /v1/checks.

  • Add /v1/messages and a checks endpoint that accept Anthropic Messages API format requests, with request/response schemas and SSE streaming that emits tool_use blocks.
  • Adds the optional anthropic dependency to the server, all, and est_integration extras, since the server schemas depend on the anthropic SDK types.
  • Adds documentation for the endpoints and additions to openapi spec

Note: Depends on:

Related Issue(s)

#2226

Verification

AI Assistance

  • No AI tools were used.
  • AI tools were used; a human reviewed and can explain every change (tool: Claude code).

Checklist

  • I've read the CONTRIBUTING guidelines.
  • This PR links to a triaged issue assigned to me.
  • My PR title follows the project commit convention.
  • I've updated the documentation if applicable.
  • I've added tests if applicable.
  • I've noted any verification beyond CI and any checks I couldn't run.
  • I did not update generated changelog files manually.
  • I addressed all CodeRabbit, Greptile, and other review comments, or replied with why no change is needed.
  • @mentions of the person or team responsible for reviewing proposed changes.

Add an optional reasoning field to the ChatMessage dataclass so
reasoning content survives round-tripping through to_dict/from_dict,
and extract it from OpenAI-compatible responses via the 'reasoning'
key in addition to 'reasoning_content'.

Signed-off-by: Rob Geada <rob@geada.net>
@github-actions github-actions Bot added size: XL status: needs triage New issues that have not yet been reviewed or categorized. needs: signing labels Aug 12, 2026
@github-actions

github-actions Bot commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

PR merge guidance

@RobGeada thanks for the PR. GitHub is currently blocking merge for one or more repository requirements:

  • This branch has merge conflicts with develop. Please rebase your branch on the latest develop, resolve the conflicts locally, and force-push the updated branch.
  • 3 commits do not have a verified signature (26e6b0e, 8f415a4, 778f511). Please sign the commits and force-push the updated branch.

Relevant guide:

Signed-off-by: Rob Geada <rob@geada.net>
Add /v1/messages and a checks endpoint that accept Anthropic Messages
API format requests, with request/response schemas and SSE streaming
that emits tool_use blocks. Stream tool calls through the handler in
_stream_llm_call so the SSE formatter can surface them.

Add the optional anthropic dependency to the server, all, and
test_integration extras, since the server schemas depend on the
anthropic SDK types.

Document the endpoints: add an "Anthropic Messages" server guide page,
add both endpoints to the OpenAPI spec (fern/openapi.yml) and the docs
navigation and API reference layout.

Signed-off-by: Rob Geada <rob@geada.net>
@RobGeada
RobGeada force-pushed the feat/anthropic-server-endpoints branch from 3a47ddd to 778f511 Compare August 21, 2026 08:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs: rebase needs: signing size: XL status: needs triage New issues that have not yet been reviewed or categorized.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant