workqueue: Fix setting affinity of unbound worker threads