Skip to content

[Bug] opd的 hf格式加载有一些问题想问 #226

Description

@illusionnnnnnn

--student-hf(HF 格式,通过 bridge 转成 Megatron)❌ 失败
411 + → 指向含 config.json + safetensors 的 HF 目录
412 + → 经过 Megatron HF bridge 转换
413 + → 所有尝试都失败("start from random")
414 + 例: --student-hf .../hf/iter_0000082/
415 + ├── config.json
416 + ├── model.safetensors-00001-of-00004.safetensors
417 + └── tokenizer.json
现在通过load-dir模式加载megatron格式的student模型,但是在思考这个ref model需要加载sft hf 模型,可以正常加载么

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions