Skip to content

对mininmonkey使用全参数微调训练loss曲线波动大 #177

@hamster-oom

Description

@hamster-oom

使用全参数微调的脚本minimonkey_finetune_full.sh对模型进行微调后,使用tensorboard观察训练曲线波动很大,这是正常的吗?从评估结果来看,评估结果和原文很接近,但是loss曲线波动很大。

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions