[Script request]: NVIDIA NeMo Switchyard #16550
Unanswered
icf20
asked this question in
Request script
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Application Name
Switchyard
Official Website
https://github.com/NVIDIA-NeMo/Switchyard
Source Repository
https://github.com/NVIDIA-NeMo/Switchyard
Repository Stars
1600
Minimum Adoption Requirement
Description
Switchyard is a Rust proxy and library for LLM traffic. It routes requests across providers, translates between OpenAI and Anthropic APIs, records operational metrics, and provides typed, composable routing algorithms.
Why should this be added?
hermes agent nomnom tokens, costs go brrr
Installation Notes
should be installed with Hermes https://community-scripts.org/scripts/hermesagent
reading more about why u want this on self hosted mode https://forum.level1techs.com/t/stop-wasting-cloud-tokens-local-ai-ftw/253759
Due Diligence
All reactions