Revert "clk: bcm: rpi: Turn firmware clock on/off when preparing/unpr… #4335

Job	Run time
build (bcm2835, arm, bcm2835_defconfig, kernel)	6m 35s
build (arm64, arm64, defconfig, kernel8)	23m 36s
build (bcm2709, arm, bcm2709_defconfig, kernel7)	20m 10s
build (bcmrpi, arm, bcmrpi_defconfig, kernel)	18m 24s
build (bcm2712, arm64, bcm2712_defconfig, kernel_2712)	26m 17s
build (bcm2711_rt, arm64, bcm2711_rt_defconfig, kernel8_rt)	26m 55s
build (bcm2711, arm64, bcm2711_defconfig, kernel8)	25m 42s
	2h 27m 39s

Provide feedback