ARM: OMAP2+: omap_device: fix crash on omap_device removal