用WiFi信号实现更精准的人体姿态估计,解决跨域和骨骼结构失真问题。
Towards Robust and Realistic Human Pose Estimation via WiFi Signals
- 分两阶段设计:先学通用时序特征,再约束骨骼拓扑结构
- 在多个数据集上显著提升2D/3D姿态估计精度,降低关节错位率
- 适合做无摄像头人体追踪的物联网与隐私敏感场景
基于WiFi信号的人体姿态估计(HPE)面临两大关键挑战:一是源域与目标域间姿态分布差异大导致的跨域差距;二是预测骨架拓扑扭曲,表现为关节位置偏移和骨长比例失真。本文提出新型两阶段框架DT-Pose,包含域一致表征学习与拓扑约束解码。首先在自监督掩码预训练中引入带均匀性正则的时间一致性对比学习,增强对稀疏信号的鲁棒表征,避免模式坍塌。其次设计融合显式骨骼拓扑约束的混合解码器,补偿WiFi语义向量缺乏空间先验的缺陷,建模邻接与全局关节关系,生成更真实的姿态。在多个基准数据集上的实验表明,该方法在2D/3D WiFi-HPE任务中显著优于现有方法。代码已开源。
原文摘要 · Abstract (English)
Robust WiFi-based human pose estimation (HPE) is a challenging task that bridges discrete and subtle WiFi signals to human skeletons. We revisit this problem and reveal two critical yet overlooked issues: 1) cross-domain gap, i.e., due to significant discrepancies in pose distributions between source and target domains; and 2) structural fidelity gap, i.e., predicted skeletal poses manifest distorted topology, usually with misplaced joints and disproportionate bone lengths. This paper fills these gaps by reformulating the task into a novel two-phase framework dubbed DT-Pose: Domain-consistent representation learning and Topology-constrained Pose decoding. Concretely, we first propose a temporal consistency contrastive learning strategy with uniformity regularization, integrated into a self-supervised masked pretraining paradigm. This design facilitates robust learning of domain-consistent and motion-discriminative WiFi representations while mitigating potential mode collapse caused by signal sparsity. Beyond this, we introduce an effective hybrid decoding architecture that incorporates explicit skeletal topology constraints. By compensating for the inherent absence of spatial priors in WiFi semantic vectors, the decoder enables structured modeling of both adjacent and overarching joint relationships, producing more realistic pose predictions. Extensive experiments conducted on various benchmark datasets highlight the superior performance of our method in tackling these fundamental challenges in 2D/3D WiFi-based HPE tasks. The associated code is released at https://github.com/cseeyangchen/DT-Pose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。