Skip to content

Commit d8bb07d

Browse files
Revise Nemotron 3 model details in README (#101)
Updated model specifications and descriptions for Nemotron 3 Super and Nano. Co-authored-by: Marc Romeyn <mromeijn@nvidia.com>
1 parent 1118307 commit d8bb07d

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -87,17 +87,17 @@ Because these are complete systems, you can extract specific techniques with con
8787

8888
| Model | Description | Stages | Guide |
8989
|-------|-------------|--------|-------|
90-
| **[Nemotron 3 Super](docs/nemotron/super3/README.md)** | 253B total MoE Transformer for frontier reasoning, coding, and agentic tasks | Pretrain → SFT → RL | [Training Guide](docs/nemotron/super3/README.md) |
91-
| **[Nemotron 3 Nano](docs/nemotron/nano3/README.md)** | 3.6B active / 31.6B total MoE Hybrid Mamba-Transformer for agentic reasoning | Pretrain → SFT → RL | [Training Guide](docs/nemotron/nano3/README.md) |
90+
| **[Nemotron 3 Super](docs/nemotron/super3/README.md)** | 120.6B total / 12.7B active Hybrid Mamba Latent MoE Transformer for frontier reasoning, coding, and agentic tasks | Pretrain → SFT → RL | [Training Guide](docs/nemotron/super3/README.md) |
91+
| **[Nemotron 3 Nano](docs/nemotron/nano3/README.md)** | 31.6B total / 3.6B active MoE Hybrid Mamba-Transformer for agentic reasoning | Pretrain → SFT → RL | [Training Guide](docs/nemotron/nano3/README.md) |
9292

9393
### Nemotron 3 Super
9494

95-
A complete training recipe for the frontier Mixture-of-Experts Transformer model with state-of-the-art reasoning, coding, and agentic capabilities.
95+
A complete training recipe for the frontier Hybrid Mamba Latent Mixture-of-Experts Transformer model with state-of-the-art reasoning, coding, and agentic capabilities.
9696

9797
> **Open-Source Data Only**: These recipes train exclusively on the open-sourced subset of training data. Results will differ from the tech report benchmarks, which used additional proprietary data. Use these recipes as reference implementations to apply the methodology with your own data.
9898
9999
**Model Specifications**:
100-
- 253B total parameters, Mixture-of-Experts Transformer
100+
- 120B total / 12B active parameters
101101
- Multi-stage RL pipeline: 3× RLVR + 2× SWE-RL + RLHF across 21 reward environments
102102
- Asynchronous GRPO with decoupled training and inference
103103

0 commit comments

Comments
 (0)