用脉冲神经网络实现低功耗WiFi多动作识别,精度高且能耗减半。
Wi-Spike: A Low-power WiFi Human Multi-action Recognition Model with Spiking Neural Networks
- 基于脉冲神经网络的事件驱动架构,适合边缘设备实时处理。
- 在多动作识别上达95.83%准确率,能耗比传统方法降低50%以上。
- 适用于隐私敏感场景下的智能监控与可穿戴设备部署。
基于WiFi的人体动作识别(HAR)因其非侵入性和隐私保护特性受到广泛关注。然而,现有模型多聚焦于提升识别准确率,对功耗和能效问题关注不足。本文提出Wi-Spike,一种基于脉冲神经网络(SNN)的高效精准动作识别框架,利用WiFi信道状态信息(CSI)信号。通过引入脉冲卷积层进行时空特征提取,并设计新型时间注意力机制增强判别性表征;后续特征经脉冲全连接层与投票层编码分类。在三个基准数据集(NTU-Fi-HAR、NTU-Fi-HumanID、UT-HAR)上的实验表明,Wi-Spike在单动作识别中表现优异,在多动作识别任务中达到领先水平。在能效方面,其能量消耗至少降低一半,同时保持95.83%的识别准确率。该模型建立了基于WiFi的多动作识别新基准,为实时、低功耗边缘感知应用提供了可行方案。
原文摘要 · Abstract (English)
WiFi-based human action recognition (HAR) has gained significant attention due to its non-intrusive and privacy-preserving nature. However, most existing WiFi sensing models predominantly focus on improving recognition accuracy, while issues of power consumption and energy efficiency remain insufficiently discussed. In this work, we present Wi-Spike, a bio-inspired spiking neural network (SNN) framework for efficient and accurate action recognition using WiFi channel state information (CSI) signals. Specifically, leveraging the event-driven and low-power characteristics of SNNs, Wi-Spike introduces spiking convolutional layers for spatio-temporal feature extraction and a novel temporal attention mechanism to enhance discriminative representation. The extracted features are subsequently encoded and classified through spiking fully connected layers and a voting layer. Comprehensive experiments on three benchmark datasets (NTU-Fi-HAR, NTU-Fi-HumanID, and UT-HAR) demonstrate that Wi-Spike achieves competitive accuracy in single-action recognition and superior performance in multi-action recognition tasks. As for energy consumption, Wi-Spike reduces the energy cost by at least half compared with other methods, while still achieving 95.83% recognition accuracy in human activity recognition. More importantly, Wi-Spike establishes a new state-of-the-art in WiFi-based multi-action HAR, offering a promising solution for real-time, energy-efficient edge sensing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。