Just to be on the safe side, don't update timestamps against anything but voice packets.