Skip to content

Fix first token handling in speculative decoding - #2308

Open
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token
Open

Fix first token handling in speculative decoding#2308
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token

Fix first token handling in speculative decoding

eccca07
Select commit
Loading
Failed to load commit list.
Lit OSS [bot] / tests.yaml / Lit Job (n/a) succeeded Aug 25, 2026 in 16m 13s

Job Completed Successfully

All checks passed

Details

The CI job completed successfully.

View more details on Lit OSS [bot]