CJK rendering error

[VincentTam]

Background

I've authored #33 by introducing typst-dev-assets.

Problem

Recently, I've found that this bot can't render some Chinese character, such as "禛" in the name of Emperor Yongzheng (雍正帝).

Discussion

Using my web font tester, I found out that each of typst-dev-assets' font files for Noto CJK fonts has only about 3MB—this is much smaller than usual, so no wonder many characters are missing.

Workaround for Docker users

Thanks to Claude, who generated the code for the font() function, I can now move stuff to somewhere /bot/fonts, then blindly mount it in the docker compose file. Each time there's a change in the font/ folder, it suffices to docker compose restart. No need to rebuild image.

The worker will know, at compile time, to search fonts from /bot/fonts.

[mattfbacon]

I think the problem is that we rely on typst-dev-assets which is really not intended for this purpose. It probably only includes the CJK chars that are necessary for docs and testing, for example. At this moment I can't remember why we switched to using it, but I think it might be a good idea to return to bundling our own assets.

[VincentTam]

Not knowing Rust myself (I'll learn it soon), I don't know if the additional fonts would blow up the compiled binary.
Not having any much experiences of hosting apps on remote machines, idk if users would be concerned about the filesize of the final product.
I've already got what I wanted, and I can't say what would the burden of maintaining the fonts be

Noto Sans/Serif is already good enough cuz it covers a very large part of the CJK characters if you aren't chasing for the beauty in fonts like me.

[mattfbacon]

Well one of the advantages of using typst-dev-assets is that our output generally matches the examples in the docs which is useful when users copy over the code to try something out. So I will probably just add Noto Sans/Serif as a fallback -- I think that was their intended purpose.

Binary size is unimportant for me, the binary only runs on hosters' servers.