You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/inference/inference-options.mdx
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -61,10 +61,12 @@ The first six are always available.
61
61
Ollama appears when you have installed or started it on the host.
62
62
Local vLLM appears when NemoClaw detects a running vLLM server.
63
63
The managed install/start vLLM entry appears by default on DGX Spark and DGX Station, and appears on generic Linux NVIDIA GPU hosts after opt-in.
64
+
During interactive NVIDIA Endpoints onboarding, NemoClaw fetches NVIDIA's featured-models catalog for the model picker.
65
+
If the catalog cannot be fetched or returns no safe model IDs, the wizard uses the curated fallback list shown below.
64
66
65
67
| Option | Description | Curated models |
66
68
|--------|-------------|----------------|
67
-
| NVIDIA Endpoints | Routes to models hosted on [build.nvidia.com](https://build.nvidia.com). You can also enter any model ID from the catalog. Set `NVIDIA_INFERENCE_API_KEY`. | Nemotron 3 Super 120B, Nemotron 3 Ultra 550B, GLM-5.1, MiniMax M2.7, GPT-OSS 120B, DeepSeek V4 Pro|
69
+
| NVIDIA Endpoints | Routes to models hosted on [build.nvidia.com](https://build.nvidia.com). You can also enter any model ID from the catalog. Set `NVIDIA_INFERENCE_API_KEY`. | Nemotron 3 Ultra 550B, Nemotron 3 Super 120B, GLM5.1, Kimi K2.6, Minimax M2.7|
68
70
| OpenAI | Routes to the OpenAI API. Set `OPENAI_API_KEY`. |`gpt-5.4`, `gpt-5.4-mini`, `gpt-5.4-nano`, `gpt-5.4-pro-2026-03-05`|
69
71
| Other OpenAI-compatible endpoint | Routes to any server that implements `/v1/chat/completions`. NemoClaw uses `/v1/chat/completions` at runtime by default; set `NEMOCLAW_PREFERRED_API=openai-responses` to allow `/v1/responses` for proxies that implement it, such as some llama.cpp builds. The wizard prompts for a base URL and model name. The adapter is validated against OpenRouter (refer to the status table above); behavior on other OpenAI-compatible proxies, gateways, and self-hosted implementations such as LocalAI or llama.cpp may vary. When you enable Telegram messaging, onboarding also runs a bounded sandbox-side smoke check through `https://inference.local/v1/chat/completions`. Set `COMPATIBLE_API_KEY`. | You provide the model name. |
70
72
| Anthropic | Routes to the Anthropic Messages API. Set `ANTHROPIC_API_KEY`. |`claude-sonnet-4-6`, `claude-haiku-4-5`, `claude-opus-4-6`|
@@ -78,18 +80,16 @@ The managed install/start vLLM entry appears by default on DGX Spark and DGX Sta
78
80
79
81
Use this table as starter guidance when selecting a curated cloud model during onboarding.
80
82
The provider catalog remains authoritative for exact context-window limits, availability, and current pricing.
83
+
The table covers the fallback curated choices; the fetched NVIDIA featured-models catalog can include newer featured models.
81
84
The relative labels below are qualitative and compare models within the curated onboarding choices, not across every model a provider offers.
82
85
83
86
| Model | Best-for task type | Relative latency | Tool-use quality | Context-window fit | Relative cost |
84
87
|---|---|---|---|---|---|
85
-
|`nvidia/nemotron-3-super-120b-a12b`| Default hosted agent work, multi-step planning, and tool-heavy shell workflows | Medium | Strong default for OpenClaw tool loops | Large agent context | Medium |
86
88
|`nvidia/nemotron-3-ultra-550b-a55b`| Quality-sensitive reasoning, careful synthesis, and complex reviews | Higher | Strong for complex tool plans | Large agent context | Higher |
87
-
|`nvidia/nemotron-3-nano-omni-30b-a3b-reasoning`|Reasoning-first and multimodal experiments where a compact hosted model is enough | Medium |Good after the smoke probe confirms final-answer content| Large agent context | Medium |
89
+
|`nvidia/nemotron-3-super-120b-a12b`|Default hosted agent work, multi-step planning, and tool-heavy shell workflows | Medium |Strong default for OpenClaw tool loops| Large agent context | Medium |
88
90
|`z-ai/glm-5.1`| General chat, multilingual text work, and fast iteration | Low-to-medium | Good for straightforward tool loops | Large agent context | Low-to-medium |
89
-
|`minimaxai/minimax-m2.7`| Long-form writing, multi-turn assistant work, and broad instruction following | Medium | Good for structured assistant turns | Large agent context | Medium |
90
91
|`moonshotai/kimi-k2.6`| Coding tasks and shell-heavy agent trajectories | Medium | Strong with NemoClaw's Kimi tool-call compatibility path | Large-context friendly | Medium |
91
-
|`openai/gpt-oss-120b`| Hosted open-weight style experimentation and cost-aware general agents | Medium | Good when provider-side tool calling is enabled | Large agent context | Medium |
92
-
|`deepseek-ai/deepseek-v4-pro`| Code, math, and reasoning-heavy problem solving | Medium-to-high | Strong when the endpoint supports tool calls | Large agent context | Medium-to-high |
92
+
|`minimaxai/minimax-m2.7`| Long-form writing, multi-turn assistant work, and broad instruction following | Medium | Good for structured assistant turns | Large agent context | Medium |
93
93
|`gpt-5.4`| Default OpenAI-backed agent work and general high-quality reasoning | Medium | Strong | Large agent context | Medium-to-high |
94
94
|`gpt-5.4-mini`| Latency-sensitive routine automation and repeated helper calls | Low | Good | Medium-to-large context | Low |
95
95
|`gpt-5.4-nano`| Very low-latency classification, routing, extraction, and small helper tasks | Very low | Basic to good for simple tool loops | Medium context | Very low |
0 commit comments