cachefiles: Fix race between inactivating and culling a cache object