arXiv:2409.00356cs.SDcs.AI2024-09中稿 · the ICPR2024被引 1

无需标注数据,通过声音增强与对比学习提升关键词识别效果。

Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technology

  • 利用声音增强和瓶颈层特征相似性实现无监督训练。
  • 在谷歌语音命令数据集上达到领先性能,减少对标注数据依赖。
  • 适合关键词频繁变更或标注成本高的语音系统场景。

本文针对语音技术中关键词检测(KWS)长期存在的标注数据获取难题,提出一种结合无监督对比学习与独特增强技术的新方法。该方法使神经网络可在未标注数据上训练,有望在少量标注数据下提升下游任务性能。我们主张,即使语速或音量不同,同一关键词的语音片段也应具有相似的高层特征表示。为此,提出一种基于语音增强的无监督学习方法,利用瓶颈层特征与音频重建信息之间的相似性进行辅助训练。此外,设计了一种压缩卷积架构,以缓解KWS任务中的冗余与非信息性问题,使模型能同时捕捉局部特征并关注长期信息。该方法在Google Speech Commands V2数据集上表现优异。受近期符号检测与语音词项检测进展启发,本方法突显了对比学习在KWS中的潜力及基于查询的语音词项检测策略的优势。所提出的CAB-KWS为降低数据收集成本、提升系统鲁棒性提供了新思路。

原文摘要 · Abstract (English)

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of positive samples and the laborious process of collecting new target samples when the keyword changes, we introduce a novel approach combining unsupervised contrastive learning and a unique augmentation-based technique. Our method allows the neural network to train on unlabeled data sets, potentially improving performance in downstream tasks with limited labeled data sets. We also propose that similar high-level feature representations should be employed for speech utterances with the same keyword despite variations in speed or volume. To achieve this, we present a speech augmentation-based unsupervised learning method that utilizes the similarity between the bottleneck layer feature and the audio reconstructing information for auxiliary training. Furthermore, we propose a compressed convolutional architecture to address potential redundancy and non-informative information in KWS tasks, enabling the model to simultaneously learn local features and focus on long-term information. This method achieves strong performance on the Google Speech Commands V2 Dataset. Inspired by recent advancements in sign spotting and spoken term detection, our method underlines the potential of our contrastive learning approach in KWS and the advantages of Query-by-Example Spoken Term Detection strategies. The presented CAB-KWS provide new perspectives in the field of KWS, demonstrating effective ways to reduce data collection efforts and increase the system's robustness.

关键词检测无监督学习语音增强对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。