One of the key techniques we have used is NTK-aware interpolation (bloc97, 2023), which adjusts the scale to prevent the loss of high-frequency information in a training-free manner.

[eyuansu62]

why the high-frequency information would be lost?
Maybe the low-freq information?

[jklj077]

I think this was answered in #343. I'll close the discussion for now.