Search results

Concurrent text-serving throughput does not scale above serial despite PagedAttention engaged (v0.9.0, H100, Llama-3.2-1B bf16)

Status: Open.

#2343 In EricLBuehler/mistral.rs;

· dharmater opened on Jul 12, 2026

Unsupported group_size: 6 on CUDA

bugSomething isn't workingSomething isn't working

Status: Open.

#2340 In EricLBuehler/mistral.rs;

· svenstaro opened on Jul 12, 2026

Web UI: sending an image returns HTTP 500 invalid image source (v1 API works)

Status: Open.

#2336 In EricLBuehler/mistral.rs;

· subin9 opened on Jul 11, 2026

Llama-3.2-11B-Vision (mllama): errors with PagedAttention by default, and image inference crashes on CUDA with --paged-attn off

Status: Open.

#2335 In EricLBuehler/mistral.rs;

· subin9 opened on Jul 11, 2026

sampler: greedy paths report log of raw logit instead of log of probability

Status: Open.

#2329 In EricLBuehler/mistral.rs;

· dx2102 opened on Jul 9, 2026

Re-export pinned candle versions (or at least candle-core::Device)

new featureNew feature or requestNew feature or request

Status: Open.

#2328 In EricLBuehler/mistral.rs;

· thiezn opened on Jul 9, 2026

Batched multimodal prefill crashes with rank mismatch; mixed-length image batches silently corrupt output (Gemma 4)

Status: Open.

#2323 In EricLBuehler/mistral.rs;

· achandi opened on Jul 8, 2026

MemoryUsage::query runs sysinfo System::new_all() in the attention hot path (CPU + integrated CUDA)

Status: Open.

#2322 In EricLBuehler/mistral.rs;

· achandi opened on Jul 8, 2026

PagedAttentionScheduler::schedule livelocks with concurrent multimodal requests

Status: Open.

#2321 In EricLBuehler/mistral.rs;

· achandi opened on Jul 8, 2026

candle-kernels build_lib() fails on Windows MSVC + CUDA 13.3 (MoE static library)

Status: Open.

#2310 In EricLBuehler/mistral.rs;

· freezed-corpse-143 opened on Jul 6, 2026

Proposal: additive KV cache connector seam at paged-attention block pool

Status: Open.

#2308 In EricLBuehler/mistral.rs;

· Travis-Gilbert opened on Jul 5, 2026

LFM2: batched inference (2+ concurrent requests) produces corrupted output or shape-mismatch error

Status: Open.

#2306 In EricLBuehler/mistral.rs;

· tugot17 opened on Jul 3, 2026