研究语音在噪声中可懂度,发现相位谱在嘈杂环境下更关键。
Intelligibility of Speech in Noise: Investigating Contribution of Magnitude and Phase Spectra

- 分离语音的幅度和相位谱,分别测试其对语音识别的影响。
- 相位谱在噪声中比幅度谱更能保持语音可懂度。
- 摩擦音和近音在噪声中更稳定,鼻音最易受干扰。
已知环境噪声会降低语音可懂度,但不同声音受影响程度不一,元音比辅音更具鲁棒性。本研究在稳态白噪声与非稳态人声干扰噪声条件下,评估各类辅音的可懂度。通过三个实验,分别分析语音信号中幅度谱和相位谱对人类语音识别的独立贡献:实验1对比干净语音、仅含幅度谱重构信号(仅幅度信号)及仅含相位谱重构信号(仅相位信号)的可懂度;实验2在干净语音加噪后,从噪声语音中重构出仅幅度与仅相位信号,并测试其可懂度;实验3直接在干净语音重构的仅幅度与仅相位信号上叠加噪声,评估其可懂度。结果表明,在无噪声条件下,幅度谱对可懂度贡献更大;而在噪声环境中,相位谱信息更具鲁棒性。此外,辅音中鼻音最易受噪声影响,而摩擦音与近音相对更稳健。
原文摘要 · Abstract (English)
It is well known that intelligibility of speech reduces in the presence of ambient noise. However, studies show that all sounds are not affected uniformly (or equally) and that vowels are more robust to noise than consonants. In this study, intelligibility of various consonants is assessed and analyzed in stationary white noise and non-stationary babble noise conditions. Specifically, this study investigates the individual contribution of magnitude and phase spectra of a given speech signal on human speech recognition of consonants in noisy conditions. In this regard, three experiments are carried out. In experiment 1, clean signal, signal reconstructed with only magnitude spectrum information (magnitude only signal) and signal reconstructed with only phase spectrum information (phase only signal) are assessed for intelligibility. In experiment 2, noise is added to clean speech. From noisy speech, phase only signal and magnitude only signal are reconstructed and intelligibility tests are performed for all these three signals. In experiment 3, noise is added directly to the magnitude only and phase only signals reconstructed from clean speech and their intelligibility is assessed. Results of these experiments show that magnitude spectrum contributes more to intelligibility in clean condition than phase spectrum, while information from phase spectrum is more robust in noisy conditions. It is also observed that, among consonants, nasals are more susceptible to noise whereas fricatives and approximants were observed to be comparatively more robust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。