Only try to detect silence when we actually need to, instead of...always.