Commit 5937047
committed
fix(sdk): enable thinking mode on the llama.cpp VLM path
Gemma-4 ships an mmproj file so it loads as a VLM and runs through
vlm.cpp, which hardcoded enable_thinking=false and dropped special
tokens in token_to_piece. Pass enable_thinking through and render
special tokens so reasoning channel delimiters reach the caller.
Also enable allow_special_tokens for all models on the LLM path so
reasoning delimiters are never silently swallowed.
Closes qcom-ai-hub/geniex#1208
Signed-off-by: Paul Zhu <paulzhuzx@gmail.com>1 parent 30c1aef commit 5937047
2 files changed
Lines changed: 3 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
51 | | - | |
| 51 | + | |
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
154 | 154 | | |
155 | 155 | | |
156 | 156 | | |
157 | | - | |
158 | | - | |
159 | | - | |
160 | | - | |
| 157 | + | |
161 | 158 | | |
162 | 159 | | |
163 | 160 | | |
| |||
399 | 396 | | |
400 | 397 | | |
401 | 398 | | |
402 | | - | |
| 399 | + | |
403 | 400 | | |
404 | 401 | | |
405 | 402 | | |
| |||
0 commit comments