About the problem that Cot Layer cannot run on multiple cards

[xiangchiqingyu]

Hello author, I tried to extract the Cot Layer in CotNet, but found that the Cot Layer can only run on a single card. If running on multiple cards, the following error will be reported: ”ValueError: Caught ValueError in replica 0 on device 0“.
I don't know why, and I hope to get your guidance.