ASoC: uda1380: make driver more powersave-friendly