用物理约束的复杂模型提升WiFi人体姿态估计跨环境泛化能力
C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimation
- 融合物理先验的复数域Mamba-GraFormer架构,保留相位信息
- 跨环境测试下性能超越现有方法,参数量减少超80%
- 无需预训练即可实现高精度,适合隐私敏感场景应用
利用无线WiFi信号进行无设备人体姿态估计(HPE)因其无需佩戴设备、保护隐私且抗遮挡和弱光而备受关注。然而,现有方法常忽略WiFi信道状态信息(CSI)的物理复数相位特性,导致在不同环境间泛化能力差。本文提出C-MambaPose,一种融合物理先验的复数域Mamba-GraFormer混合框架,用于鲁棒的跨环境3D人体姿态估计。该框架首先对原始CSI相位误差进行净化,构建保持相位特性的复数表示;再通过时空复数Mamba编码器捕获精细相位动态,其动态选择性感受野可自适应调整;随后采用交叉注意力关节查询映射将非结构化序列标记转换为人体关节点,由图卷积网络(GCN)解码生成解剖学一致的3D坐标。在MM-Fi数据集上的大量实验表明,C-MambaPose在所有设置下均达到或优于当前最优基线,在具有挑战性的跨环境划分上取得新纪录,仅需3.78M参数,相比GraphPose-Fi减少83.1%,相比MetaFi++减少85.7%,与DT-Pose规模相当(小18%),但无需预训练即实现显著更优性能。
原文摘要 · Abstract (English)
Human pose estimation (HPE) utilizing wireless WiFi signals has emerged as a promising technology owing to its device-free nature, privacy preservation, and robustness against occlusion and poor lighting. However, existing methods often overlook the physical complex phase information of WiFi signals and fail to generalize across diverse environments due to severe domain shifts. In this paper, we present C-MambaPose, a physics-informed complex-valued Mamba-GraFormer hybrid framework for robust cross-environment WiFi-based 3D HPE. Our framework first sanitizes raw WiFi Channel State Information (CSI) phase errors and constructs a phase-preserving complex-valued representation. We then employ a Spatiotemporal Complex Mamba encoder with a dynamic selective receptive field to capture fine-grained phase dynamics. A cross-attention joint-query mapper maps the unstructured sequence tokens to human joints, which are decoded by a Graph Convolutional Network (GCN) to predict anatomically coherent 3D coordinates. Extensive evaluations on the MM-Fi dataset show that C-MambaPose achieves competitive or superior performance to state-of-the-art baselines across all settings, setting a new state-of-the-art specifically on the challenging cross-environment split, requiring only 3.78 M parameters-an 83.1\% reduction compared to GraphPose-Fi~\cite{chen2026graph} and an 85.7\% reduction compared to MetaFi++~\cite{zhou2023metafi++}, while maintaining a comparable size to DT-Pose~\cite{chen2025towards} (which is only 18\% smaller) but achieving significantly superior performance without requiring any pretraining. Our code is publicly available at https://github.com/phucngvinuni/cmampose.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。