Adding support for other tokenizer

[Barshan-Mandal]

Add support for other tokenizer please. I have gone through the whole wiki but got nothing about using other tokenizer.
Also the autotokenizer of huggingface cant add apecial token to rwkv tokenizer as per need