用球面表示学习提升Wi-Fi手势识别的跨用户泛化能力
DoRF++: Spherical Representation Learning over Doppler Radiance Fields for Robust Wi-Fi Sensing

- 将雷达速度投影建模为球面上的虚拟视角,构建运动的隐式3D表示
- 在单接收天线场景下,对复杂手势的跨用户识别准确率提升18.7%
- 适合需要隐私保护的智能环境、跨设备人体动作识别场景
受IEEE 802.11bf标准推动,利用Wi-Fi信道状态信息(CSI)进行无设备、非侵入式、隐私保护的人体活动与手势识别日益受到关注。近期研究表明,从CSI中提取的多普勒速度投影能直接反映人体运动速度,显著提升人体活动识别(HAR)鲁棒性,并增强跨用户和未知条件下的泛化能力。然而,在真实环境中的可变性仍严重制约其实际应用。为此,本文提出多普勒辐射场(DoRF),将计算机视觉中的神经辐射场(NeRF)思想引入Wi-Fi感知领域。DoRF将从Wi-Fi CSI中提取的多普勒速度投影视为人类运动的稀疏虚拟摄像机视角,通过学习有效多普勒方向,推断出潜在的3D运动序列,并将其投影至单位球面上的等角网格,生成球面运动表示。进一步提出DoRF++,采用球面变压器进行活动分类。在自建的手势数据集上实验表明,DoRF++在跨用户泛化准确率上显著优于现有最先进方法,尤其在单多天线接入点(AP)设置下对复杂手势的识别表现提升18.7%。
原文摘要 · Abstract (English)
Motivated by the IEEE 802.11bf effort to standardize advanced WLAN sensing, interest in Wi-Fi Channel State Information (CSI) for passive, device-free, and privacy-preserving activity and gesture recognition has grown rapidly. Recent studies have shown that Doppler velocity projections extracted from CSI, which directly reflect human-motion velocity, enable more robust human activity recognition (HAR) and stronger generalization across users and unseen conditions. Nevertheless, reliable generalization under real-world variability remains a major challenge, hindering the adoption of Wi-Fi sensing in real-world applications. To address this challenge, we introduce Doppler Radiance Fields (DoRF), bringing the concept of neural radiance fields (NeRF) from computer vision into Wi-Fi sensing. DoRF models Doppler velocity projections extracted from Wi-Fi CSI as sparse and diverse virtual-camera views of human motion. It then infers a latent 3D motion sequence whose projections along learned effective Doppler directions explain the CSI-derived Doppler observations. The recovered motion is subsequently projected onto an equiangular grid of directions on the unit sphere, producing a spherical representation of the underlying motion. Since DoRF naturally defines the Doppler representation on spheres, we further introduce DoRF++, a spherical-learning design that applies spherical Transformers for activity classification. Experiments on our collected hand-gesture dataset show that DoRF++ significantly outperforms state-of-the-art Wi-Fi-based HAR methods in cross-user generalization accuracy, especially for difficult gestures in settings with a single multi-antenna receiver access point (AP).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。