Add ClusterIP Service Type of Gateway

[danehans]

Component

Helm Chart

Desired use case or feature

According to https://github.com/llm-d/llm-d-deployer/blob/main/charts/llm-d/values.yaml, the following Gateway Service types are supported:

  # -- Gateway's service type. Ingress is only available if the service type is set to NodePort. Accepted values: ["LoadBalancer", "NodePort"]
  serviceType: NodePort

1. Why is the default NodePort?
2. Add type ClusterIP to support internal inference gateways.

Proposed solution

1. Update default to LoadBalancer for consistency with most upstream gateway implementations.
2. Add ClusterIP as a supported Service type.

Alternatives

No response

Additional context or screenshots

No response

[Frapschen]

/assign