[llm] Support different shape of input_pos #3850

Job	Run time
generate-matrix / generate	6s
pytorch/executorch / build-manywheel-py3_10-cpu	1m 55s
pytorch/executorch / upload / upload-manywheel-py3_10-cpu	16s
	2m 17s

Provide feedback