in that case paragraph_id is within chunks of doc_ids across the cores
in that case paragraph_id is within chunks of doc_ids across the cores