arXiv:2602.16442cs.LGcs.AI2026-02被引 2

用FPGA加速事件图神经网络,实现低功耗高实时的语音关键词识别。

Hardware-accelerated graph neural networks: an alternative approach for neuromorphic event-based audio classification and keyword spotting on SoC FPGA

  • 将事件流转为稀疏数据,结合图卷积与循环建模处理音频信号
  • 在SHD数据集上达92.7%准确率,参数量减少67倍,延迟仅10.53微秒
  • 首次实现端到端硬件加速事件音频关键词检测,适合边缘低功耗场景

随着嵌入式边缘传感器记录的数据量增加,特别是产生离散事件流的类脑设备,亟需高效、低延迟且节能的本地处理方案。本文提出一种面向音频处理的FPGA实现事件图神经网络架构。采用人工耳蜗将时序信号转换为稀疏事件数据,降低内存与计算开销。该架构部署于SoC FPGA,在两个开源数据集上评估:在SHD数据集上,基线浮点模型达到92.7%准确率,仅比当前最优结果低2.4%,同时参数量减少超过10倍和67倍;在SSC数据集上,模型准确率达66.9%-71.0%。相较基于FPGA的脉冲神经网络,量化模型准确率达到92.3%,性能提升最高达19.3%,且资源占用与延迟更低。首次完成硬件加速的SSC评估,并实现首个端到端事件音频关键词识别系统,融合图卷积与序列建模,词尾检测准确率最高达95%,延迟仅10.53微秒,功耗1.18W,建立能效新基准。

原文摘要 · Abstract (English)

As the volume of data recorded by embedded edge sensors increases, particularly from neuromorphic devices producing discrete event streams, there is a growing need for hardware-aware neural architectures that enable efficient, low-latency, and energy-conscious local processing. We present an FPGA implementation of event-graph neural networks for audio processing. We utilise an artificial cochlea that converts time-series signals into sparse event data, reducing memory and computation costs. Our architecture was implemented on a SoC FPGA and evaluated on two open-source datasets. For classification task, our baseline floating-point model achieves 92.7% accuracy on SHD dataset - only 2.4% below the state of the art - while requiring over 10x and 67x fewer parameters. On SSC, our models achieve 66.9-71.0% accuracy. Compared to FPGA-based spiking neural networks, our quantised model reaches 92.3% accuracy, outperforming them by up to 19.3% while reducing resource usage and latency. For SSC, we report the first hardware-accelerated evaluation. We further demonstrate the first end-to-end FPGA implementation of event-audio keyword spotting, combining graph convolutional layers with recurrent sequence modelling. The system achieves up to 95% word-end detection accuracy, with only 10.53 microsecond latency and 1.18 W power consumption, establishing a strong benchmark for energy-efficient event-driven KWS.

事件音频图神经网络FPGA加速关键词识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。