arXiv:2505.11817eess.AScs.LG2025-05ACL被引 10

无需存储旧数据,实现轻量级关键词持续学习。

AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting

  • 基于解析解更新模型参数,避免梯度反向传播。
  • 仅需一次训练即可适应新关键词,准确率显著提升。
  • 适合资源受限设备,兼顾隐私与效率。

关键词语音识别(KWS)在语音交互系统中至关重要,但用户需求随时间变化,需持续学习新关键词。现有方法多依赖存储和重放旧数据以缓解灾难性遗忘,但存在隐私风险及高内存与计算开销,难以部署于小设备。为此,本文提出无样本的解析式持续学习方法AnalyticKWS,通过闭式解析解更新模型参数,无需重访旧数据。该方法仅需单次迭代即可完成增量学习,避免梯度更新,大幅降低计算开销。实验表明,AnalyticKWS在多个数据集和设置下均优于现有持续学习方法,有效解决隐私、内存与效率问题,适用于资源受限场景。

原文摘要 · Abstract (English)

Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem is catastrophic forgetting, where models lose their ability to recognize earlier keywords. Although several continual learning methods have proven their usefulness for reducing forgetting, most existing approaches depend on storing and revisiting old data to combat catastrophic forgetting. Though effective, these methods face two practical challenges: 1) privacy risks from keeping user data and 2) large memory and time consumption that limit deployment on small devices. To address these issues, we propose an exemplar-free Analytic Continual Learning (AnalyticKWS) method that updates model parameters without revisiting earlier data. Inspired by efficient learning principles, AnalyticKWS computes a closed-form analytical solution for model updates and requires only a single epoch of adaptation for incoming keywords. AnalyticKWS demands fewer computational resources by avoiding gradient-based updates and does not store old data. By eliminating the need for back-propagation during incremental learning, the model remains lightweight and efficient. As a result, AnalyticKWS meets the challenges mentioned earlier and suits resource-limited settings well. Extensive experiments on various datasets and settings show that AnalyticKWS consistently outperforms existing continual learning methods.

关键词识别持续学习轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。