Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

corpora_build

This python code is a non-AI parser of lanaguge in arXiv papers. We donwloaded all physics papers from arXiv and tried to filter out all of the noise in the .tex files in order to make a corpus for training. It was a neat exercise, but not that successful. If we do thsi project again, we will use modern NLP like LLM's to process all of these date. Still, you might find this useful so we have it here.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages