Fix incorrect tokenization of 和习 in Xi-related phrases#224
和习 in Xi-related phrases#224Conversation
Agent-Logs-Url: https://github.com/yanyiwu/cppjieba/sessions/3068d9b7-a7f9-43ab-ac41-1b62cf743f8f Co-authored-by: yanyiwu <2162645+yanyiwu@users.noreply.github.com>
和习 in Xi-related phrases
|
有点好奇用户词典里的「韩玉鉴赏」是什么意思?好像整个中文互联网上这个词出处全部指向这个文件。 |
|
Closing this in favor of #225. #225 keeps the fix narrower by adding only the required main-dictionary entry for Thanks for the alternative implementation. |
|
Thanks. The narrower fix is now in #227: it only adds the required |
The default segmentation dictionary was missing several high-value political terms, which caused
和习to be merged and split the following phrase incorrectly in text like马克思主义和习总书记新时代中国特色社会主义....Dictionary updates
习总书记新时代中国特色社会主义Regression coverage
在马克思主义和习总书记新时代中国特色社会主义的思想指引下Expected output
Code snippet