DORA and BFloat16

[cesa210]

Hi, i need help with an issue, i don't know if its a bad config from my part or and actual issue with OneTrainer

When i use DORA along with Bfloat16 an error on the console appears saying:

RuntimeError: self and mat2 must have the same dtype, but got BFloat16 and Float

And the moment that i change to Float the error no longer shows up and i can train the DORA.

So is this an error from my part or something else?

[dxqb]

this is probably #1156

you can work around this by not setting everything to the same dtype (for example your VAE)
if you're not sure what this means: please post a screenshot of the models tab of your settings

[cesa210]

Yes that works, just by setting the vae to float32 i could train a lora/dora.

Thanks