spi/build: Remove SPI_SIRF from compile test