ASoC: imx-audmux: Use uintptr_t for port numbers