res_rtp_asterisk: Avoid close the rtp/rtcp fd twice.