Skip to content

Fix first token handling in speculative decoding - #2308

Open
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token
Open

Fix first token handling in speculative decoding#2308
Excelius-Wang wants to merge 1 commit into
Lightning-AI:mainfrom
Excelius-Wang:fix/speculative-first-token

Fix first token handling in speculative decoding

eccca07
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar