ASoC: wm_adsp: Move control cache sync out of preloader