app_confbridge: Fix crash caused when waitmarked/marked users leave together