用超维计算实现低功耗实时音频感知,适合微型边缘设备
Hyperdimensional Intelligent Sensing for Efficient Real-Time Audio Processing on Extreme Edge
- 结合FFT、CNN与超维计算,在近传感器端完成快速推理
- 软件测试达82.1%能耗降低,仅1.39%质量损失
- 专为小尺寸麦克风设计,适配ASIC和Edge TPU部署
日益增长的传感器数据量,尤其在音频应用中,对计算与存储提出严峻挑战。当前系统在实时场景(如枪声检测)中面临巨大算力与存储压力,边缘传感器数量激增更加剧问题。本文提出一种面向智能音频传感框架的近传感器模型,融合快速傅里叶变换(FFT)、卷积神经网络(CNN)层与超维计算(HDC),实现低功耗、快速推理与在线学习。该模型高度适配专用集成电路(ASIC)设计,能效显著优于传统嵌入式CPU或GPU,且契合微型麦克风传感器的发展趋势。软硬件联合评估表明:软件层面通过详尽的ROC曲线分析,实现最高82.1%能耗节省,仅伴随1.39%性能损失;硬件层面在采用Google Edge TPU的ASIC实现中,展现出卓越能效优势,明显优于主流嵌入式处理器。
原文摘要 · Abstract (English)
The escalating challenges of managing vast sensor-generated data, particularly in audio applications, necessitate innovative solutions. Current systems face significant computational and storage demands, especially in real-time applications like gunshot detection systems (GSDS), and the proliferation of edge sensors exacerbates these issues. This paper proposes a groundbreaking approach with a near-sensor model tailored for intelligent audio-sensing frameworks. Utilizing a Fast Fourier Transform (FFT) module, convolutional neural network (CNN) layers, and HyperDimensional Computing (HDC), our model excels in low-energy, rapid inference, and online learning. It is highly adaptable for efficient ASIC design implementation, offering superior energy efficiency compared to conventional embedded CPUs or GPUs, and is compatible with the trend of shrinking microphone sensor sizes. Comprehensive evaluations at both software and hardware levels underscore the model's efficacy. Software assessments through detailed ROC curve analysis revealed a delicate balance between energy conservation and quality loss, achieving up to 82.1% energy savings with only 1.39% quality loss. Hardware evaluations highlight the model's commendable energy efficiency when implemented via ASIC design, especially with the Google Edge TPU, showcasing its superiority over prevalent embedded CPUs and GPUs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。