Don't pass agent audio until call is confirmed (bug #3677)