raw full data used to train pretrain models

[kennyjoseph]

Cool work!

I'm trying to figure out if debias.sh downloads the actual data used to train the model or a sample (it appears to be the latter, right?)

If so, do you have a pointer to the specific wikipedia dump used to train the model?

[JieyuZhao]

Yes, you are right. It is just for a sample.

We use the wikidump, you can get access here: en_wiki_corpus