Skip to content

Add Novita AI as a supported LLM provider - #268

Merged
fangjy6 merged 3 commits into
ANative-Lab:mainfrom
jax-novita:add-novita-provider
Aug 14, 2026
Merged

Add Novita AI as a supported LLM provider#268
fangjy6 merged 3 commits into
ANative-Lab:mainfrom
jax-novita:add-novita-provider

Conversation

@jax-novita

Copy link
Copy Markdown
Contributor

Summary

Adds Novita AI as a supported LLM provider, following the same pattern as the existing SiliconFlow integration.

Changes

  • evoagentx/models/novita_model.py: new NovitaLLM class extending OpenAILLM, pointing to https://api.novita.ai/openai.
  • evoagentx/models/model_configs.py: new NovitaConfig class, mirroring SiliconFlowConfig.
  • evoagentx/models/__init__.py: export the new provider module.
  • docs/modules/llm.md / docs/zh/modules/llm.md: usage example for NovitaLLM.

Verification

  • pytest tests/src/models — 36 passed (no change vs. main, no new failures or skips).
  • MODEL_REGISTRY.get_model("novita") and get_model("NovitaLLM") both resolve to the new class.
  • Instantiated NovitaConfig + NovitaLLM and confirmed the underlying OpenAI client's base_url is https://api.novita.ai/openai.
  • Ran a live NovitaLLM.generate(...) call against the Novita API and confirmed a valid completion response.

Novita AI exposes an OpenAI-compatible chat completions API. This adds a
NovitaLLM adapter following the same pattern as SiliconFlowLLM: it
subclasses OpenAILLM, overrides client construction to point at Novita's
base URL, and records token usage without a dollar cost since LiteLLM has
no pricing data for Novita-hosted models.
The models listed for Novita were older ids that no longer reflect what
the platform leads with. Point the recommendations at the three current
flagships instead, each verified against api.novita.ai:

  moonshotai/kimi-k3              1M context, native vision
  zai-org/glm-5.2                 1M context, long-horizon agentic work
  deepseek/deepseek-v4-flash-0731 1M context, cheapest of the three

Context windows, output limits, input modalities and pricing were taken
from the live /openai/v1/models response rather than carried over.
@fangjy6
fangjy6 merged commit fd6b9a6 into ANative-Lab:main Aug 14, 2026
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants