Skip to content

@llm-d-incubation llm-d incubation

Change the repository type filter

All

    Repositories list

    18 repositories

    • llm-d-rl-time-slicing

      Public
      Go
      •
      Apache License 2.0
      •4•4•10•14•Updated Jul 12, 2026Jul 12, 2026

    • llm-d-fast-model-actuation

      Public
      Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping
      llm-d
      llm-d
      Go
      •
      Apache License 2.0
      •18•16•34•16•Updated Jul 11, 2026Jul 11, 2026

    • llm-d-async

      Public
      Asynchronous Processor for Inference Gateway. Orchestrator of queues
      Go
      •
      Apache License 2.0
      •24•10•15•4•Updated Jul 9, 2026Jul 9, 2026

    • llm-d-planner

      Public
      Python
      •
      Apache License 2.0
      •12•23•30•7•Updated Jul 9, 2026Jul 9, 2026

    • llm-d-skills

      Public
      Python
      •
      Apache License 2.0
      •10•4•3•3•Updated Jul 8, 2026Jul 8, 2026

    • py-inference-scheduler

      Public
      Python based inference-scheduler for Reinforcement Learning
      Python
      •
      Apache License 2.0
      •8•10•10•2•Updated Jul 6, 2026Jul 6, 2026

    • coordinator

      Public
      Go
      •
      Apache License 2.0
      •10•1•4•6•Updated Jul 2, 2026Jul 2, 2026

    • llm-d-modelservice

      Public
      helm charts for deploying models with llm-d
      Go Template
      •
      Apache License 2.0
      •62•31•16•8•Updated Jun 27, 2026Jun 27, 2026

    • secure-inference

      Public
      Go
      •
      Apache License 2.0
      •4•4•9•4•Updated Jun 27, 2026Jun 27, 2026

    • hermes

      Public
      Hermes is a cluster configuration scanning and self-test generation tool for llm-d inference workloads
      Rust
      •4•0•7•9•Updated Jun 25, 2026Jun 25, 2026

    • llm-d-inference-cost

      Public
      Apache License 2.0
      •1•0•0•0•Updated Jun 8, 2026Jun 8, 2026

    • weight-propagation-interface

      Public
      Python
      •
      Apache License 2.0
      •1•6•0•0•Updated Jun 5, 2026Jun 5, 2026

    • llm-d-resiliency-operator

      Public
      Makefile
      •
      Apache License 2.0
      •0•0•0•8•Updated May 18, 2026May 18, 2026

    • inference-payload-processor-rs

      Public
      Rust
      •
      Apache License 2.0
      •5•2•1•0•Updated May 14, 2026May 14, 2026

    • llm-d-infra

      Public archive
      llm-d helm charts and deployment examples
      Go Template
      •
      Apache License 2.0
      •57•58•13•11•Updated May 1, 2026May 1, 2026

    • llm-d-rl

      Public
      Python
      •2•0•1•2•Updated Apr 17, 2026Apr 17, 2026

    • ig-wva

      Public
      Workload Variant Autoscaler is a service to compute the cost-optimal provisioning of heterogeneous accelerators for inference workloads with varying request lat…
      Jupyter Notebook
      •2•2•34•0•Updated Mar 10, 2026Mar 10, 2026

    • llm-d-ci

      Public
      Shell
      •2•2•9•0•Updated Mar 10, 2026Mar 10, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.