关于零卷积作用

[Deng555]

你好，在推理阶段，brushnet每个模块输出，都是经过零卷积后才注入到main unet相应的层中，请问为什么不是直接注入？是为了归一还是为了抑制控制分支？

[lixiaowen-xw]

As mentioned in BrushNet, “This ensures that harmful noise does not influence the hidden states in the trainable copy(BrushNet branch) during the initial stages of training.”