个性化语音重建对部分人有效，客观指标常高估实际听感质量
Subjective quality evaluation of personalized own voice reconstruction systems
- 通过数据增强与微调实现个性化语音重建
- 仅部分说话者在主观听感上优于通用系统
- 客观指标常夸大质量，适合语音评估研究者参考
可穿戴设备的自声采集技术有助于嘈杂环境中通信。自声重建（OVR）系统能提升录制的自声信号质量与可懂度。由于干扰因素因人而异，个性化OVR系统可能优于通用系统。本文通过数据增强与微调实现个性化OVR，与通用系统对比，评估其在不同条件下的语音质量。我们使用客观指标评估质量，并开展主观听觉测试，比较预测质量与实际主观评分。结果表明，个性化OVR仅对部分说话者有显著优势；且客观指标常高估实际听感质量，尤其在特定干扰下表现一致偏高。
原文摘要 · Abstract (English)
Own voice pickup technology for hearable devices facilitates communication in noisy environments. Own voice reconstruction (OVR) systems enhance the quality and intelligibility of the recorded noisy own voice signals. Since disturbances affecting the recorded own voice signals depend on individual factors, personalized OVR systems have the potential to outperform generic OVR systems. In this paper, we propose personalizing OVR systems through data augmentation and fine-tuning, comparing them to their generic counterparts. We investigate the influence of personalization on speech quality assessed by objective metrics and conduct a subjective listening test to evaluate quality under various conditions. In addition, we assess the prediction accuracy of the objective metrics by comparing predicted quality with subjectively measured quality. Our findings suggest that personalized OVR provides benefits over generic OVR for some talkers only. Our results also indicate that performance comparisons between systems are not always accurately predicted by objective metrics. In particular, certain disturbances lead to a consistent overestimation of quality compared to actual subjective ratings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。