vhost_net: handle polling errors when setting backend