Skip to content

fix(tokenizer): decode_stream drops leading space per-word on the huggingface backend - #2326

Open
999thBaam wants to merge 1 commit into
Lightning-AI:mainfrom
999thBaam:learn/decode-stream-hf-spacing
Open

999thBaam wants to merge 1 commit into
Lightning-AI:mainfrom
999thBaam:learn/decode-stream-hf-spacing

fix(tokenizer): decode_stream drops leading space per-word on the hug…

246348f
Select commit
Loading
Failed to load commit list.
Lit OSS [bot] / tests.yaml / Lit Job (compiler) succeeded Sep 9, 2026 in 31m 1s

Job Completed Successfully

All checks passed

Details

The CI job completed successfully.