Simplify threadpool refcounting a bit.