logger: Fix a potential callid reference leak discovered in development