针对远距离麦克风场景，实现低延迟语音增强与去混响。
How much to Dereverberate? Low-Latency Single-Channel Speech Enhancement in Distant Microphone Scenarios
- 在5至10米远距离下，提出实时单通道语音增强方法。
- 发现早期反射保留能显著提升信号质量，尤其在短衰减时间场景。
- 适用于会议厅、剧院等大空间语音增强，提升可懂度与音质。
去混响是语音增强（SE）的重要子任务，可提升语音的可懂度和质量。然而，由于混响与语音信号高度相关，该任务仍具挑战性。现有单通道语音增强研究主要聚焦于混响时间短（通常低于1秒）、房间体积小（小于1000立方米）及距离短（不超过2米）的场景。本文探索在远距离麦克风场景（如5至10米）下的实时低延迟单通道语音增强，重点关注会议厅与剧院等大空间场景，其具有更大体积和更长混响时间。首先，证明此类复杂场景下单通道语音增强是可行的。其次，分析房间体积与混响时间的关系，并强调其在随机模拟房间冲激响应时的重要性。最后，表明在短衰减时间条件下，保留早期反射后再衰减房间传输函数，可显著提升整体信号质量。
原文摘要 · Abstract (English)
Dereverberation is an important sub-task of Speech Enhancement (SE) to improve the signal's intelligibility and quality. However, it remains challenging because the reverberation is highly correlated with the signal. Furthermore, the single-channel SE literature has predominantly focused on rooms with short reverb times (typically under 1 second), smaller rooms (under volumes of 1000 cubic meters) and relatively short distances (up to 2 meters). In this paper, we explore real-time low-latency single-channel SE under distant microphone scenarios, such as 5 to 10 meters, and focus on conference rooms and theatres, with larger room dimensions and reverberation times. Such a setup is useful for applications such as lecture demonstrations, drama, and to enhance stage acoustics. First, we show that single-channel SE in such challenging scenarios is feasible. Second, we investigate the relationship between room volume and reverberation time, and demonstrate its importance when randomly simulating room impulse responses. Lastly, we show that for dereverberation with short decay times, preserving early reflections before decaying the transfer function of the room improves overall signal quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。