用脉冲神经网络让可穿戴设备更省电,识别动作更高效
Towards Green Wearable Computing: A Physics-Aware Spiking Neural Network for Energy-Efficient IMU-based Human Activity Recognition

- 基于人体关节物理约束设计动态神经结构
- 实现98%动态功耗降低,精度达当前最优
- 适合长期运行的低功耗可穿戴设备
基于惯性测量单元(IMU)的人体活动识别(HAR)依赖深度神经网络(DNN),但其高计算与存储需求严重制约了电池供电的边缘设备。脉冲神经网络(SNN)虽具事件驱动的能效优势,却难以处理复杂的生物力学拓扑和时序梯度退化问题。为此,我们提出物理感知脉冲神经网络(PAS-Net),一种完全无乘法器的架构,专为绿色HAR设计。空间上,自适应对称拓扑混合器引入人体关节物理约束;时间上,采用$O(1)$内存因果神经调制器,实现上下文感知的动态阈值神经元,可主动适应非平稳运动节奏。此外,通过时间脉冲误差目标,实现连续IMU流的灵活早退出机制。在七个不同数据集上评估,PAS-Net达到当前最优精度,将密集运算替换为稀疏0.1 pJ整数累加。关键的是,其置信度驱动的早退出能力使动态能耗降低高达98%。PAS-Net为持续监测的可穿戴传感建立了稳健、超低功耗的类脑标准。源码与预训练模型已公开于https://github.com/zhengnaichuan2022/PAS-Net.git。
原文摘要 · Abstract (English)
Wearable IMU-based Human Activity Recognition (HAR) relies heavily on Deep Neural Networks (DNNs), which are burdened by immense computational and buffering demands. Their power-hungry floating-point operations and rigid requirement to process complete temporal windows severely cripple battery-constrained edge devices. While Spiking Neural Networks (SNNs) offer extreme event-driven energy efficiency, standard architectures struggle with complex biomechanical topologies and temporal gradient degradation. To bridge this gap, we propose the Physics-Aware Spiking Neural Network (PAS-Net), a fully multiplier-free architecture explicitly tailored for Green HAR. Spatially, an adaptive symmetric topology mixer enforces human-joint physical constraints. Temporally, an $O(1)$-memory causal neuromodulator yields context-aware dynamic threshold neurons, adapting actively to non-stationary movement rhythms. Furthermore, we leverage a temporal spike error objective to unlock a flexible early-exit mechanism for continuous IMU streams. Evaluated across seven diverse datasets, PAS-Net achieves state-of-the-art accuracy while replacing dense operations with sparse 0.1 pJ integer accumulations. Crucially, its confidence-driven early-exit capability drastically reduces dynamic energy consumption by up to 98\%. PAS-Net establishes a robust, ultra-low-power neuromorphic standard for always-on wearable sensing. The source code and pre-trained models are publicly available at https://github.com/zhengnaichuan2022/PAS-Net.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。