fix(spi): Fix bus clock for ESP32-P4 + remove S2 leftover #4620

Job	Run time
Push event file	3s
Generate matrix	7s
Build (validation, esp32c3) / Build validation tests for esp32c3	1m 42s
Build (validation, esp32c6) / Build validation tests for esp32c6	1m 43s
Build (validation, esp32s3) / Build validation tests for esp32s3	1m 42s
Build (validation, esp32h2) / Build validation tests for esp32h2	1m 42s
Build (validation, esp32p4) / Build validation tests for esp32p4	1m 26s
Build (validation, esp32s2) / Build validation tests for esp32s2	1m 42s
Build (validation, esp32) / Build validation tests for esp32	1m 41s
QEMU	0s
Hardware	0s
	11m 48s

Provide feedback