About Video inpainting results

[Mr-Kyrie]

Hi
I tested a short 10 frame videos. but the inpainting result is poor.
anything wrong about my testing?
input resolution is 432 × 240 and without any promot.

[zibojia]

We have noticed this problem, this is mainly due to that the model that you used is not the best model. We will released the best model which can remove objects without prompt after this paper is accepted.

[Mr-Kyrie]

Do you mean The CoCoCo checkpoints are not the best?

[zibojia]

Yes, the model on onedrive is the weak version.

[Mr-Kyrie]

OK, Thanks for replying.
I have another question, is the video length used for inference only applicable to shorter videos, about 10-20 frames?
I have predicted the video using 96-frame video will cause dimension mismatch problems, just like RuntimeError: The size of tensor a (11088) must match the size of tensor b (10000) at non-singleton dimension 1

[zhangp365]

OK, Thanks for replying. I have another question, is the video length used for inference only applicable to shorter videos, about 10-20 frames? I have predicted the video using 96-frame video will cause dimension mismatch problems, just like RuntimeError: The size of tensor a (11088) must match the size of tensor b (10000) at non-singleton dimension 1

I have the same problem, and I modify the max_len to 20000, and it passes.

I can't find any inpainting effect.

when running, It is often OOM on my two 4090 with 24 vram.

[mychina75]

We have noticed this problem, this is mainly due to that the model that you used is not the best model. We will released the best model which can remove objects without prompt after this paper is accepted.

sorry to say, why could you release the best model only after paper is accpeted?
Show the better result during paper under review could help the accepetance, maybe.

[zibojia]

We have noticed this problem, this is mainly due to that the model that you used is not the best model. We will released the best model which can remove objects without prompt after this paper is accepted.

sorry to say, why could you release the best model only after paper is accpeted?
Show the better result during paper under review could help the accepetance, maybe.

Yes, we will release the best model after its acceptance. The model uses same arch but with more pleasing removal effect and won't generate the shutterstock watermark.

[zhangp365]

@zibojia @Mr-Kyrie @zhangp365 hi guys where can I try this model with an interface like yours, on huggingface space? really appreciated any response

not hugging face space, just local machine