SeaLLMs-Audio-7B is based on the Qwen2-Audio-7B audio encoder and Qwen2.5-7B-Instruct models. To train your own model, you can follow the steps below:
- Install the required packages by running
pip install -r scripts/requirements.txt. - Prepare the training data. You can refer to the sample data in
scripts/train_examples.jsonfor the data format. - Initialize the model by running
python scripts/initialize_new_model.py. - Train the model by running
source scripts/sft.sh.