Commit f3e88df
authored
Move Mistral Medium recipe under canonical base model (#2150)
### What does this PR do?
Type of change: Bug fix
Moves the Mistral Medium 3.5 checkpoint-mirror PTQ recipe under the
canonical Hugging Face base model, `mistralai/Mistral-Medium-3.5-128B`.
Updates the recipe catalog, loader smoke-test path, and changelog.
### Usage
```bash
python examples/hf_ptq/hf_ptq.py \
--model mistralai/Mistral-Medium-3.5-128B \
--recipe huggingface/models/mistralai/Mistral-Medium-3.5-128B/ptq/nvfp4-max-calib
```
### Testing
- `uvx --from pre-commit pre-commit run --files CHANGELOG.rst
modelopt_recipes/huggingface/models/mistralai/Mistral-Medium-3.5-128B/ptq/nvfp4-max-calib.yaml
modelopt_recipes/ptq.md tests/unit/recipe/test_loader.py`
- Recipe documentation consistency checks (all passed)
- Focused pytest was unavailable locally because the checkout
environment lacks pytest/Torch; the dedicated pre-commit recipe
validator passed.
### Before your PR is "*Ready for review*"
- Is this change backward compatible?: ❌ The built-in recipe path
changes; the changelog documents the replacement path.
- If you copied code from any other sources or added a new PIP
dependency, did you follow guidance in `CONTRIBUTING.md`: N/A
- Did you write any new necessary tests?: ✅ Updated the built-in recipe
loader smoke test.
- Did you update
[Changelog](https://github.com/NVIDIA/Model-Optimizer/blob/main/CHANGELOG.rst)?:
✅
- Did you get Claude approval on this PR?: N/A
### Additional Information
The recipe targets the vendor's canonical base checkpoint,
[`mistralai/Mistral-Medium-3.5-128B`](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B),
and reproduces NVIDIA's
[`Mistral-Medium-3.5-128B-NVFP4`](https://huggingface.co/nvidia/Mistral-Medium-3.5-128B-NVFP4)
quantization map.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **New Features**
* Added a Mistral Medium 3.5 128B post-training quantization recipe
supporting NVFP4 and FP8 configurations with max calibration.
* **Documentation**
* Updated checkpoint-mirror guidance to reflect the new model-based
recipe location.
* **Breaking Changes**
* Saved references to the previous recipe path must be updated to the
new Mistral Medium 3.5 recipe path.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Signed-off-by: Chad Voegele <cvoegele@nvidia.com>1 parent c15d2b5 commit f3e88df
4 files changed
Lines changed: 5 additions & 4 deletions
File tree
- modelopt_recipes
- huggingface/models/mistralai/Mistral-Medium-3.5-128B/ptq
- tests/unit/recipe
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
235 | 235 | | |
236 | 236 | | |
237 | 237 | | |
238 | | - | |
| 238 | + | |
239 | 239 | | |
240 | 240 | | |
241 | 241 | | |
| |||
335 | 335 | | |
336 | 336 | | |
337 | 337 | | |
338 | | - | |
| 338 | + | |
339 | 339 | | |
340 | 340 | | |
341 | 341 | | |
342 | 342 | | |
343 | | - | |
| 343 | + | |
344 | 344 | | |
345 | 345 | | |
346 | 346 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
167 | 167 | | |
168 | 168 | | |
169 | 169 | | |
170 | | - | |
| 170 | + | |
171 | 171 | | |
172 | 172 | | |
173 | 173 | | |
| |||
0 commit comments