Skip to content
This repository was archived by the owner on Jun 20, 2026. It is now read-only.

add configurable gateway replicas#279

Closed
nicole-lihui wants to merge 1 commit into
llm-d-incubation:mainfrom
nicole-lihui:supported-configurable-gateway-replicas
Closed

add configurable gateway replicas#279
nicole-lihui wants to merge 1 commit into
llm-d-incubation:mainfrom
nicole-lihui:supported-configurable-gateway-replicas

Conversation

@nicole-lihui

Copy link
Copy Markdown
Contributor

use gateway.gatewayParameters.replicas to configure gateway replicas.

in production env, gateway replica count must be configurable, but this is not supported today.

Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant