image patch embedding

[frederhoon]

大佬您好，目前我用alphaclip输出的image_embedding是一维的，请问我要怎么获得image打成patch过程中二维的patch embedding？是否能有中间这一部分的输出呢？

[SunzeY]

可以将被拉长的feature reshape还原成二维，参考这里

nh = attentions.shape[1]
attentions = attentions[0, :, 0, 1:].reshape(nh, -1)
p_s = int(math.sqrt(attentions.shape[1]))
attentions = attentions.reshape(nh, p_s, p_s)