Skip to content

Reproducing Table3.  #57

Description

@mjyun01

CUDA_VISIBLE_DEVICES=0 python opt.py facebook/opt-350m wikitext2 --wbits 3 --new-eval

Table 3 in GPTQ paper reporting wikitext PPL 33.79, but I got 31.90.
How can I get exactly same result with paper?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions