Availability of Checkpoints with Shared Expert

[hxu105]

Hi, thank you for the great work on this project. I noticed that enabling the shared expert appears to require continued training. I was wondering whether the team plans to make any checkpoints with the shared expert publicly available (e.g., via Hugging Face).

Many thanks!

[Muennighoff]

Thanks, I don't have access to the buckets anymore but maybe @aman-17 can help