Hyperparameters

[ekurtulus]

What are the hyperparameters for replicating SeaLLMs/SeaLLM-7B-v1 and SeaLLMs/SeaLLM-7B-v2 ?

[nxphi47]

@ekurtulus Hi there.

The models are trained on close-sourced data, so I'm not sure if it is replicable.

Cheers.

[ekurtulus]

@ekurtulus Hi there.

The models are trained on close-sourced data, so I'm not sure if it is replicable.

Cheers.

Similar size and quality datasets can still be curated. That's why I believe the community would be interested in hyperparameters.