feat(accent): local UniDic + POS-driven patches - #53

Closed

torrid-fish wants to merge 29 commits into

mainfrom

feat/local-unidic

Commits on Jun 4, 2026

refactor(accent): replace greedy aligner with Needleman-Wunsch DP
torrid-fish
committed
0e668f0
feat(accent): regex reading-override layer + URL/non-JP preprocessing
torrid-fish
committed
8931d3e
feat(accent): add /MarkAccent/stream/ NDJSON endpoint + dev helpers
torrid-fish
committed
bab83e8
feat(accent): swap Yahoo MA for local fugashi + UniDic (refs #50)

torrid-fish
and
claude
committed
330c6bd
docs(accent): extend package README for new package shape (refs #50)

torrid-fish
and
claude
committed
0fa9214
chore(spike): import spike artefacts — docs + probe scripts (refs #50)

torrid-fish
and
claude
committed
8cf7a37
fix(accent): merge acronyms + decimals to keep morae aligned (refs #50)

torrid-fish
and
claude
committed
83a476a
fix(accent): english_compound k=0 free, stop DP stealing morae (refs #50)

torrid-fish
and
claude
committed
97952cd
chore: drop Yahoo-era config/, .env, and spike scripts/docs (refs #50)

torrid-fish
and
claude
committed
76d01b6
feat(accent): symbol readings, okurigana subwords, scripts (refs #50)

torrid-fish
and
claude
committed
99c6623
refactor(accent): drop merge_readable_symbol_compounds (refs #50)

torrid-fish
and
claude
committed
64f54be
fix(accent): preserve unit-compound furigana from toggle wipe (refs #50)

torrid-fish
and
claude
committed
e9f4ffe
feat(accent): user patch table for OJAD/UniDic misreads (refs #50)

torrid-fish
and
claude
committed
d9432b3
feat(accent): per-mora accent override in USER_PATCHES (refs #50)

torrid-fish
and
claude
committed
429f275
refactor(accent): explicit per-mora int tuples in USER_PATCHES (refs #50)

torrid-fish
and
claude
committed
436194e
fix(accent): free-consume override-synthesized tokens (refs #50)

torrid-fish
and
claude
committed
bff2d49
fix(accent): clear katakana per-mora furigana when toggle off (refs #50)

torrid-fish
and
claude
committed
aba22b9
docs(accent): rewrite api/accent/README.md in English (refs #50)

torrid-fish
and
claude
committed
a2c4188
fix(docker): download UniDic dict at build to fix MarkAccent 500

torrid-fish
and
claude
committed
36dfbda
chore: update ignore file and remove unused test scripts
torrid-fish
committed
a6ab1e3
chore: remove unused test
torrid-fish
committed
e746364
docs: update root readme
torrid-fish
committed
7bf63ec
feat: add version-selectable dict cwj and csj script
torrid-fish
committed
c8f7811
fix(docker): install curl in builder stage for download_unidic.sh

torrid-fish
and
claude
committed
5b88135
fix(accent): propagate chunk warning through /MarkAccent/ aggregation

torrid-fish
and
claude
committed
6260235
fix(accent): make tagger singleton thread-safe with lru_cache

torrid-fish
and
claude
committed
a68052c
docs(accent): drop stray comment from USER_PATCHES schema table

torrid-fish
and
claude
committed
5b07a93
perf(accent): defer tokeniser-count debug log formatting

torrid-fish
and
claude
committed
eb72d9d
fix(accent): cancel in-flight chunk tasks on client disconnect

torrid-fish
and
claude
committed
c509f70

Navigation Menu

Uh oh!

feat(accent): local UniDic + POS-driven patches - #53

feat(accent): local UniDic + POS-driven patches#53
torrid-fish wants to merge 29 commits into
mainfrom
feat/local-unidic

Commits on Jun 4, 2026

refactor(accent): replace greedy aligner with Needleman-Wunsch DP

feat(accent): regex reading-override layer + URL/non-JP preprocessing

feat(accent): add /MarkAccent/stream/ NDJSON endpoint + dev helpers

feat(accent): swap Yahoo MA for local fugashi + UniDic (refs #50)

docs(accent): extend package README for new package shape (refs #50)

chore(spike): import spike artefacts — docs + probe scripts (refs #50)

fix(accent): merge acronyms + decimals to keep morae aligned (refs #50)

fix(accent): english_compound k=0 free, stop DP stealing morae (refs #50)

chore: drop Yahoo-era config/, .env, and spike scripts/docs (refs #50)

feat(accent): symbol readings, okurigana subwords, scripts (refs #50)

refactor(accent): drop merge_readable_symbol_compounds (refs #50)

fix(accent): preserve unit-compound furigana from toggle wipe (refs #50)

feat(accent): user patch table for OJAD/UniDic misreads (refs #50)

feat(accent): per-mora accent override in USER_PATCHES (refs #50)

refactor(accent): explicit per-mora int tuples in USER_PATCHES (refs #50)

fix(accent): free-consume override-synthesized tokens (refs #50)

fix(accent): clear katakana per-mora furigana when toggle off (refs #50)

docs(accent): rewrite api/accent/README.md in English (refs #50)

fix(docker): download UniDic dict at build to fix MarkAccent 500

chore: update ignore file and remove unused test scripts

chore: remove unused test

docs: update root readme

feat: add version-selectable dict cwj and csj script

fix(docker): install curl in builder stage for download_unidic.sh

fix(accent): propagate chunk warning through /MarkAccent/ aggregation

fix(accent): make tagger singleton thread-safe with lru_cache

docs(accent): drop stray comment from USER_PATCHES schema table

perf(accent): defer tokeniser-count debug log formatting

fix(accent): cancel in-flight chunk tasks on client disconnect