用仿真数据解决毫米波人体动作识别方向变化难题,仅需少量实测样本即可实现高精度
Dual-Attention and Adversarial Transfer Networks for Sim-to-Real Cross-Orientation Wireless Sensing

- 基于物理模型生成多方向无线信号数据,减少真实标注成本
- 双注意力网络提取抗方向干扰的动作特征,仿真数据准确率达88.33%
- 对抗迁移学习仅用16个无标签实测样例即提升至95%准确率,适合资源受限场景
毫米波人体动作识别在用户相对感知系统方向改变时性能显著下降,而收集多方向标注数据代价高昂。为避免大量实测数据需求,我们开发了一种物理引导的仿真器,从单方向运动数据合成多方向无线训练数据。为抑制方向引起的特征变化,提出双注意力网络,从双链路多普勒谱图中提取具有活动区分性且方向鲁棒的表征。为弥合仿真到现实的差距,引入对抗式无监督迁移学习机制,仅用少量未标注目标域样本对齐特征分布。S2M-Sense平台在60.48 GHz毫米波实测数据上验证了高保真度,模拟与实测多普勒谱图间平均结构相似性指数(SSIM)达0.84,覆盖所有4种动作和4种方向。实验表明,仅使用双链路多方向仿真数据时,识别准确率为88.33%,经仿真到现实迁移学习后提升至95%,且无论是否使用迁移学习均优于现有跨域感知方法。
原文摘要 · Abstract (English)
Millimeter-wave human activity recognition suffers significant performance degradation when the user's orientation changes relative to the sensing system, yet collecting labeled multi-orientation data is labor-intensive and costly. To eliminate the need for exhaustive multi-orientation measured data, we develop a physics-guided simulator that synthesizes orientation-diverse wireless training data from single-orientation motion. Specifically, to suppress orientation-induced feature variations, we propose a dual-attention network that extracts activity-discriminative and orientation-robust representations from dual-link Doppler spectrograms. To bridge the simulation-to-reality gap, we introduce an adversarial unsupervised transfer learning mechanism that aligns feature distributions using only a small number of unlabeled target-domain samples. The S2M-Sense platform shows high fidelity in reproducing real-world signatures, validated against 60.48 GHz mmWave measured data with an average structural similarity index measure (SSIM) of 0.84 between simulated and measured Doppler spectrograms across all 4 activities and 4 orientations. Experimental results show that S2M-Sense achieves 88.33% recognition accuracy using only the dual-link multi-orientation simulated dataset, which improves to 95% after simulation-to-reality transfer learning with as few as 16 unlabeled measured samples. Both cases with and without transfer learning outperform state-of-the-art cross-domain sensing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。