-
Notifications
You must be signed in to change notification settings - Fork 352
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#2670 In llm-d/llm-d-router;
perf(epp): per-block allocations in precise-prefix-cache match counting
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2667 In llm-d/llm-d-router;[Observability] Measure observability (tracing) performance overhead for llm-d-router
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2665 In llm-d/llm-d-router;[omni/diffusion support]: Route the async /v1/videos follow-up requests to the pod that owns the job
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2663 In llm-d/llm-d-router;prefix-cache-affinity-filter: TTFT load gate compares observed values against substituted defaults when an endpoint lacks its load attribute
good first issueGood for newcomersGood for newcomerskind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.Status: Open.#2650 In llm-d/llm-d-router;- Status: Open.#2648 In llm-d/llm-d-router;
/render breaking prefix affinity for precise KV cache routing
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2641 In llm-d/llm-d-router;- Status: Open.#2640 In llm-d/llm-d-router;
[Observability] Link metrics to traces with Prometheus exemplars
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2637 In llm-d/llm-d-router;[P/D] Add opt-in fallback when no Decode endpoint is eligible
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2636 In llm-d/llm-d-router;[Coordinator] Serve Responses turns that use server-side tool calling
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2629 In llm-d/llm-d-router;P/D disaggregation returns 429 when no decode endpoints are available
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2628 In llm-d/llm-d-router;