Skip to content

About the title of the Wikipedia during pretraining #18

@shunyuzh

Description

@shunyuzh

Hi Luyu, @luyug

Thanks for your interesting work!

My question is how the title is used during your pre-training, especially in coCondenser pre-training?

Is it just a span in the list of spans?

{'spans': List[str]} ...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions