Also unref the pvt when we delete the provisional keepalive job.