ath10k: don't rebuild all the time