Improve performance on large files

[omentic]

My class has been using eggs althroughout the semester -- we've now got an eight-thousand line file with about ~250 examples and ~1000 subexamples. The Typst editor is getting a little slow, as a result. The live preview still works pretty great but occasionally the compiler runs out of memory and crashes, and when adding/removing function calls it takes a couple of seconds for the preview to chug before updating.

I would like to go through and profile Typst on this file, to see if there's any performance eggs is leaving on the table, or if it's just that ~1000 subexamples is a very large amount of subexamples. I'm opening this issue to remind me to do it after my term papers are done.

[retroflexivity]

hi omentic,

this is probably because of a lot of uses of context needed to apply the stateful config (took me too much time to realize this is probably not the best approach to configuration...)

i'm actually rn in the process of rewriting eggs with elembic, which should improve the performance. hope to release it this week or the next. stay tuned

[omentic]

Oh interesting! Will be cool to see. I can help test for regressions once you're done.

[retroflexivity]

@omentic the changes are out in branch elembic. quick tests show that the initial compile time has actually increased significantly, with the incremental one unchanged... but you can still try it. there should be no breaking changes. i'll try to find what's causing this

[retroflexivity]

nah, seems like it's just elembic's overhead, i don't think there's anything i can do. i would still like to release it because it fixes some important cases of non-convergence and overall makes things cleaner. tell me if it's much worse than it used to be

[omentic]

Hmm, would you maybe mind waiting a week? I'm really busy with term papers right now but would like to test it out!