小模型在边缘设备上实现抗噪关键词识别的持续学习方法
Domain-Incremental Continual Learning for Robust and Efficient Keyword Spotting in Resource Constrained Systems
- 融合双特征与多级降噪,动态更新完整量化模型
- 在-10 dB信噪比下仍保持94%以上准确率,清洁数据达99.63%
- 适合部署于资源受限、环境变化频繁的边缘设备
在边缘设备上部署的小型关键词识别(KWS)系统面临因噪声和录音条件变化导致的领域漂移问题。本文提出一种面向持续学习的综合框架,通过集成双输入卷积神经网络(使用MFCC和梅尔频谱图特征),结合离散小波变换与谱减法的多阶段降噪流程,以及模型与原型更新模块,实现对新领域的自适应。不同于仅更新部分层的方法,本方案可更新完整量化模型,得益于紧凑架构设计。运行时通过类别原型与置信度筛选子集样本,伪标注后与回放缓冲区结合进行增量训练。实验表明,在嘈杂测试集上,该框架在干净数据中达到99.63%准确率,并在多种噪声环境下保持超过94%性能,即使在-10 dB信噪比条件下依然有效。结果验证了高效降噪与基于原型的持续学习结合,可使KWS模型在资源受限、动态环境中自主稳定运行。
原文摘要 · Abstract (English)
Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a comprehensive framework for continual learning designed to adapt to new domains while maintaining computational efficiency. The proposed pipeline integrates a dual-input Convolutional Neural Network, utilizing both Mel Frequency Cepstral Coefficients (MFCC) and Mel-spectrogram features, supported by a multi-stage denoising process, involving discrete wavelet transform and spectral subtraction techniques, plus model and prototype update blocks. Unlike prior methods that restrict updates to specific layers, our approach updates the complete quantized model, made possible due to compact model architecture. A subset of input samples are selected during runtime using class prototypes and confidence-driven filtering, which are then pseudo-labeled and combined with rehearsal buffer for incremental model retraining. Experimental results on noisy test dataset demonstrate the framework's effectiveness, achieving 99.63\% accuracy on clean data and maintaining robust performance (exceeding 94\% accuracy) across diverse noisy environments, even at -10 dB Signal-to-Noise Ratio. The proposed framework work confirms that integrating efficient denoising with prototype-based continual learning enables KWS models to operate autonomously and robustly in resource-constrained, dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。