KEDA start up performance at scale, over 4k scaled objects

[jochbru]

Hey everyone,

I'm running keda with over 4000 scaledobjects. During startup the keda operator intiliazes all the scaled objects with messages like this: Initializing Scaling logic according to ScaledObject Specification. With this amount of scaled objects, the starting up is taking around 35 minutes during which scaling is not working.

See the screenshot:

is there a way to speed up this startup? Or shard the objects between multiple pods?

[jochbru]

Answering my own question:

There is a env variable we can pass: KEDA_SCALEDOBJECT_CTRL_MAX_RECONCILES, this defaults to 5. Increasing this drastically decreases start up time.