Skip to content

Use ncclAvg reduce op instead of future hook that divide tensor by world size #34

Open
Open
Use ncclAvg reduce op instead of future hook that divide tensor by world size#34
Labels
enhancementNew feature or requesthelp wantedExtra attention is neededpytorch-1.11Features available in PyTorch 1.11

Description

@gpauloski
gpauloski
opened on Mar 10, 2022

pytorch/pytorch#62303

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is neededpytorch-1.11Features available in PyTorch 1.11

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions