用WiFi信号实现轻量级人体姿态估计,无需穿戴设备且隐私安全
Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention

- 通过动态卷积核与通道-频率注意力机制,提升WiFi信号识别能力
- 在MM-Fi和WiPose数据集上分别达到85.96%和94.27%的PCK50准确率
- 适合资源受限设备部署,抗噪能力强,实测在0.5噪声方差下仍保持80%性能
基于WiFi的人体姿态估计(HPE)可在不依赖可穿戴设备的前提下,检测和解析人体位置与动作,同时保障个人隐私。该技术需兼顾模型性能与效率,尤其适用于资源受限设备。本文提出一种新框架WiLHPE,实现轻量化、高效的基于WiFi CSI信号的人体姿态估计。训练阶段借助摄像头模型,测试阶段直接处理原始WiFi信号。其采用新型神经网络架构,动态学习卷积核,并在通道与频率空间应用注意力机制,增强信号表征能力而不增加复杂度。同时,使用树状结构帕尔真估计器(Tree-Structured Parzen Estimator)高效优化关键超参数,显著缩短调参时间。在MM-Fi与WiPose数据集上的实验表明,该方法优于现有先进方法,分别获得85.96%与94.27%的PCK50指标,计算开销极小。尤其在高斯白噪声(AWGN)环境下,误差方差为0.5时,仍能维持约80%的准确率。
原文摘要 · Abstract (English)
WiFi-based human pose estimation (HPE) enables the detection and interpretation of human body positions and movements without the need for wearable devices while preserving individual privacy concerns. Implementing this solution requires enhancing model performance and maintaining efficiency, especially on resource-constrained devices. This paper introduces a novel framework, WiLHPE, for lightweight and efficient human pose estimation using WiFi CSI signals. Empowered by a camera-based model during training, WiLHPE processes raw WiFi signals directly to estimate human poses in the testing phase. It employs a novel neural network architecture to dynamically learn convolutional kernels and apply attention mechanisms across channel and frequency spaces. This innovative method diversifies the kernels to improve the recognition capabilities of WiFi signals without adding complexity, ensuring efficiency. Additionally, the Tree-Structured Parzen Estimator algorithm is employed to optimize the critical hyperparameters of the neural network efficiently, minimizing the time required for optimal hyperparameter search compared to heuristic methods. Results from experiments on both the MM-Fi and WiPose datasets highlight the superiority of WiLHPE over state-of-the-art approaches, achieving 85.96% and 94.27% at PCK50, respectively, with minimal computational overhead. Notably, WiLHPE performs impressively even under challenging conditions, maintaining around 80% at PCK50 under AWGN noise with an error variance of 0.5.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。