devlink: share user_ptr pointer for both devlink and devlink_port