arXiv:2504.16655cs.CV2025-04被引 1

用WiFi信号实现隐私保护的跌倒与活动识别

WiFi based Human Fall and Activity Recognition using Transformer based Encoder Decoder and Graph Neural Networks

  • 融合变换器与图神经网络,从WiFi信道信息重建人体骨骼
  • 在20人跌倒场景数据集上达到与视觉系统相当的识别准确率
  • 适合老人居家监测等注重隐私的应用场景

人体姿态估计与动作识别在健康监护、康复及辅助技术中具有重要意义。本文提出一种新型架构TED Net,用于从WiFi信道状态信息(CSI)中估计人体骨骼姿态。该模型结合卷积编码器与基于变换器的注意力机制,捕捉CSI信号中的时空特征。估计出的骨骼姿态作为输入,送入定制化的有向图神经网络(DGNN)进行动作识别。我们在两个数据集上验证了模型:一个公开的多模态数据集用于评估通用姿态估计性能,另一个新采集的数据集聚焦于20名参与者参与的跌倒场景。实验结果表明,TED Net在姿态估计上优于现有方法,且DGNN使用基于CSI的骨骼姿态实现了可靠的分类性能,与基于RGB的方法相当。值得注意的是,该模型在跌倒与非跌倒情形下均保持鲁棒表现。这些发现凸显了基于CSI的人体骨骼估计在家庭环境中(如老年人跌倒检测)实现有效动作识别的潜力。在此类场景中,WiFi信号通常可得,提供了一种比持续摄像头监控更隐私保护的替代方案。

原文摘要 · Abstract (English)

Human pose estimation and action recognition have received attention due to their critical roles in healthcare monitoring, rehabilitation, and assistive technologies. In this study, we proposed a novel architecture named Transformer based Encoder Decoder Network (TED Net) designed for estimating human skeleton poses from WiFi Channel State Information (CSI). TED Net integrates convolutional encoders with transformer based attention mechanisms to capture spatiotemporal features from CSI signals. The estimated skeleton poses were used as input to a customized Directed Graph Neural Network (DGNN) for action recognition. We validated our model on two datasets: a publicly available multi modal dataset for assessing general pose estimation, and a newly collected dataset focused on fall related scenarios involving 20 participants. Experimental results demonstrated that TED Net outperformed existing approaches in pose estimation, and that the DGNN achieves reliable action classification using CSI based skeletons, with performance comparable to RGB based systems. Notably, TED Net maintains robust performance across both fall and non fall cases. These findings highlight the potential of CSI driven human skeleton estimation for effective action recognition, particularly in home environments such as elderly fall detection. In such settings, WiFi signals are often readily available, offering a privacy preserving alternative to vision based methods, which may raise concerns about continuous camera monitoring.

WiFi感知动作识别隐私保护图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。