arXiv:2503.21335cs.ARcs.AI2025-03被引 5

为边缘设备设计低功耗语音增强加速器,实现小模型与高能效。

A Low-Power Streaming Speech Enhancement Accelerator For Edge Devices

  • 通过领域和流式感知剪枝压缩模型,减小93.9%体积。
  • 采用无softmax注意力与批归一化,降低延迟并简化硬件。
  • 基于1D处理阵列,仅用207.8K门电路、53.75KB SRAM,功耗仅8.08mW。

基于Transformer的语音增强模型效果出色,但其异构复杂结构限制了模型压缩潜力,导致硬件效率低下,且不适用于流式与低功耗场景。本文提出一种面向边缘设备的低功耗流式语音增强加速器,通过模型与硬件协同优化。所提高性能模型结合模型压缩与目标应用需求,采用领域感知与流式感知剪枝技术,使模型规模缩小93.9%。通过批归一化改进的Transformer进一步降低延迟,并引入无softmax注意力机制,辅以额外批归一化,简化硬件设计。定制硬件将多样计算模式分解为逐元素乘累加(MAC),采用可配置的SRAM寻址1维处理阵列,有效降低硬件复杂度并简化零值跳过。基于台积电40nm CMOS工艺实现,最终芯片仅需207.8K门电路和53.75KB SRAM,在62.5MHz频率下实时推理功耗仅为8.08mW。

原文摘要 · Abstract (English)

Transformer-based speech enhancement models yield impressive results. However, their heterogeneous and complex structure restricts model compression potential, resulting in greater complexity and reduced hardware efficiency. Additionally, these models are not tailored for streaming and low-power applications. Addressing these challenges, this paper proposes a low-power streaming speech enhancement accelerator through model and hardware optimization. The proposed high performance model is optimized for hardware execution with the co-design of model compression and target application, which reduces 93.9\% of model size by the proposed domain-aware and streaming-aware pruning techniques. The required latency is further reduced with batch normalization-based transformers. Additionally, we employed softmax-free attention, complemented by an extra batch normalization, facilitating simpler hardware design. The tailored hardware accommodates these diverse computing patterns by breaking them down into element-wise multiplication and accumulation (MAC). This is achieved through a 1-D processing array, utilizing configurable SRAM addressing, thereby minimizing hardware complexities and simplifying zero skipping. Using the TSMC 40nm CMOS process, the final implementation requires merely 207.8K gates and 53.75KB SRAM. It consumes only 8.08 mW for real-time inference at a 62.5MHz frequency.

语音增强边缘计算低功耗硬件加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。