Skip to content

Fix first token handling in speculative decoding - #2308

Open
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token
Open

Fix first token handling in speculative decoding#2308
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token

Fix first token handling in speculative decoding

eccca07
Select commit
Loading
Failed to load commit list.
Lit OSS [bot] / tests.yaml / Lit Job (compiler) failed Aug 25, 2026 in 15m 41s

Job Failed

The CI job failed.

Details

Failure reason: Job ci-run-lightning-ai-litgpt-eccca07-tests-yaml-lit-job-compiler-7786fa56 failed

View more details on Lit OSS [bot]