pinctrl: intel: Only restore pins that are used by the driver