[Hardware]Add support of 0.5B, 7B and 30B models on AMD GPUs.

[Hardware]Add support of 0.5B, 7B and 30B models on AMD GPUs. #100