针对嵌入式设备设计高效关键词识别系统,兼顾精度与资源消耗。
End-to-End Efficiency in Keyword Spotting: A System-Level Approach for Embedded Microcontrollers
- 从特征提取到推理全流程优化,适配微控制器
- 仅14.4k参数达92.4% F1分数,内存占用极低
- 适合资源受限的物联网设备部署,强调系统级效率
关键词识别(KWS)是实现嵌入式与物联网设备免提交互的关键技术,但严格的内存和功耗限制给人工智能部署带来挑战。本文系统评估并对比了多种轻量级神经网络架构,包括DS-CNN、LiCoNet、TENet以及基于MobileNet设计的新型架构Typman-KWS(TKWS),专为微控制器单元(MCU)上的高效KWS而生。不同于以往仅关注模型推理的研究,本分析涵盖从梅尔频率倒谱系数(MFCC)特征提取到神经推理的完整处理流程,并在三个STM32平台(N6、H7、U5)上进行基准测试。结果表明,含三个残差块的TKWS在仅14.4k参数下达到最高92.4% F1分数,显著降低内存占用且不牺牲准确性。此外,集成神经加速器的N6 MCU展现出最佳能效延迟积(EDP),即使使用高分辨率特征也能实现高效低延迟运行。研究强调:模型精度并非决定实际效能的唯一因素,关键词识别系统的成功部署需综合考虑特征提取参数与硬件特性优化。
原文摘要 · Abstract (English)
Keyword spotting (KWS) is a key enabling technology for hands-free interaction in embedded and IoT devices, where stringent memory and energy constraints challenge the deployment of AI-enabeld devices. In this work, we systematically evaluate and compare several state-of-the-art lightweight neural network architectures, including DS-CNN, LiCoNet, and TENet, alongside our proposed Typman-KWS (TKWS) architecture built upon MobileNet, specifically designed for efficient KWS on microcontroller units (MCUs). Unlike prior studies focused solely on model inference, our analysis encompasses the entire processing pipeline, from Mel-Frequency Cepstral Coefficient (MFCC) feature extraction to neural inference, and is benchmarked across three STM32 platforms (N6, H7, and U5). Our results show that TKWS with three residual blocks achieves up to 92.4% F1-score with only 14.4k parameters, reducing memory footprint without compromising the accuracy. Moreover, the N6 MCU with integrated neural acceleration achieves the best energy-delay product (EDP), enabling efficient, low-latency operation even with high-resolution features. Our findings highlight the model accuracy alone does not determine real-world effectiveness; rather, optimal keyword spotting deployments require careful consideration of feature extraction parameters and hardware-specific optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。