Skip to content

feat: Add batched GPU inference for 5x performance improvement#1222

Closed
bagikazi wants to merge 12 commits intoobss:mainfrom
bagikazi:feat/batched-gpu-inference
Closed

feat: Add batched GPU inference for 5x performance improvement#1222
bagikazi wants to merge 12 commits intoobss:mainfrom
bagikazi:feat/batched-gpu-inference

Commits

Commits on Aug 9, 2025

Commits on Aug 11, 2025

Commits on Aug 14, 2025