Skip to content

feat(models): add quantization to novita meta mappings#2961

Merged
smakosh merged 1 commit into
theopenco:mainfrom
AmineAce:feat/quant-novita-meta
Jul 9, 2026
Merged

feat(models): add quantization to novita meta mappings#2961
smakosh merged 1 commit into
theopenco:mainfrom
AmineAce:feat/quant-novita-meta

Conversation

@AmineAce

@AmineAce AmineAce commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Adds quantization to Novita provider mappings in packages/models/src/models/meta.ts, per #2946.
Checked every Novita mapping in this file against Novita's own model detail pages. Added the field only where precision was explicitly stated, no inference from model names.

llama-3.1-8b-instruct → fp8
llama-3.3-70b-instruct → bf16
llama-4-scout-17b-16e-instruct → bf16
llama-3.2-3b-instruct → bf16

Left unchanged, llama-3-8b-instruct and llama-3-70b-instruct no longer exist on Novita's site (404 on their model page), likely retired from their catalog.
Ran pnpm format; only this file changed.

Summary by CodeRabbit

  • New Features
    • Added quantization details to several model listings, including updated support for select Llama models.
    • Improved model metadata so compatible variants can be identified more accurately during selection.

@coderabbitai

coderabbitai Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: f6cc1051-0c26-4f54-8fe4-e70193ba0fc1

📥 Commits

Reviewing files that changed from the base of the PR and between c29d267 and d099c69.

📒 Files selected for processing (1)
  • packages/models/src/models/meta.ts
🚧 Files skipped from review as they are similar to previous changes (1)
  • packages/models/src/models/meta.ts

Walkthrough

Adds a quantization field to four novita-provider entries in the metaModels catalog: "fp8" for llama-3.1-8b-instruct, and "bf16" for llama-3.3-70b-instruct, llama-4-scout-17b-instruct, and llama-3.2-3b-instruct.

Changes

Quantization metadata additions

Layer / File(s) Summary
Meta Llama model quantization fields
packages/models/src/models/meta.ts
Adds quantization field ("fp8" or "bf16") to four novita provider entries for Llama model variants.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Possibly related PRs

  • theopenco/llmgateway#2946: Both PRs add quantization fields to metaModels provider entries in the same file for Llama novita models.
  • theopenco/llmgateway#2956: Both PRs add a quantization field to novita-backed model entries in the models catalog, mapping models to "fp8"/"bf16".

Suggested reviewers: smakosh

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely summarizes the main change: adding quantization metadata to Novita model mappings.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@AmineAce AmineAce force-pushed the feat/quant-novita-meta branch from c29d267 to d099c69 Compare July 9, 2026 12:10
@smakosh smakosh added this pull request to the merge queue Jul 9, 2026
Merged via the queue into theopenco:main with commit 89173b7 Jul 9, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants