Search results

[Feature]: Direct model loading from object storage with Runai Model Streamer

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#12900 In NVIDIA/TensorRT-LLM;

· GuyStone opened on Apr 9, 2026

[Bug]: Garbage output with modelopt FP8 checkpoint in 1.2.0: use_fp8_context_fmha forced True, regression from 1.1.0

bugSomething isn't workingSomething isn't working

Model optimization<NV>Model-specific performance optimizations and tuning<NV>Model-specific performance optimizations and tuning

Status: Open.

#12877 In NVIDIA/TensorRT-LLM;

· langzhao-netizen opened on Apr 9, 2026

[RFC]: ForwardPassMetrics — per-iteration scheduler telemetry for dynamo integration

RFC

Status: Open.

#12854 In NVIDIA/TensorRT-LLM;

· venkywonka opened on Apr 8, 2026

[PyTorch backend][Qwen3] embed_tokens ignores allreduce_strategy and falls back to AUTO

Pytorch<NV>Pytorch backend related issues<NV>Pytorch backend related issues

Status: Open.

#12840 In NVIDIA/TensorRT-LLM;

· CarstyYou opened on Apr 8, 2026

[New Model]: Support Cohere Labs Command A Vision

new modelRequest to add a new modelRequest to add a new model

Status: Open.

#12839 In NVIDIA/TensorRT-LLM;

· torotoki opened on Apr 8, 2026

[Bug]: trtllm-serve 1.3.0rc10 returns "Unknown modality: image" for Qwen2.5-VL-7B-Instruct-NVFP4 on DGX Spark

bugSomething isn't workingSomething isn't working

MultimodalLabel for issues & PRs regarding Multimodal related objectsLabel for issues & PRs regarding Multimodal related objects

Status: Open.

#12824 In NVIDIA/TensorRT-LLM;

· xj999 opened on Apr 8, 2026

[Feature]: [AutoDeploy]: llmc proposal + testing

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

AutoDeploy/llmc-blocker<NV> Tag for issues that are blocking AutoDeploy standalone repo<NV> Tag for issues that are blocking AutoDeploy standalone repo

Status: Open.

Initiative

#12809 In NVIDIA/TensorRT-LLM;

· lucaslie opened on Apr 7, 2026

[Feature]: Add Gemma4 Support in AD

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#12808 In NVIDIA/TensorRT-LLM;

· bmarimuthu-nv opened on Apr 7, 2026

[Bug]: Failing to load tokenizers from gated models although they're locally downloaded

bugSomething isn't workingSomething isn't working

LLM API<NV>High-level LLM Python API & tools (e.g., trtllm-llmapi-launch) for TRTLLM inference/workflows.<NV>High-level LLM Python API & tools (e.g., trtllm-llmapi-launch) for TRTLLM inference/workflows.

Status: Open.

#12805 In NVIDIA/TensorRT-LLM;

· 1MrazorT1 opened on Apr 7, 2026

[Feature]: [AutoDeploy] Fuse quantized gemms type casting (fp8 => bf16)

Customized kernels<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

Task

#12784 In NVIDIA/TensorRT-LLM;

· taylor-yb-lee opened on Apr 6, 2026

[Feature]: [AutoDeploy] Enable ADP for larger batch sizes

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

Task

#12783 In NVIDIA/TensorRT-LLM;

· taylor-yb-lee opened on Apr 6, 2026

[Feature]: [AutoDeploy]: DeepSeek R1 optimization

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#12775 In NVIDIA/TensorRT-LLM;

· taylor-yb-lee opened on Apr 6, 2026