用WiFi信号实现跨场景手势识别,准确率达97.61%。
WiFi-based Cross-Domain Gesture Recognition Using Attention Mechanism
- 从CSI提取多角度多普勒谱,生成融合图像输入网络。
- 结合空间与通道注意力机制,提取跨域通用特征。
- 在Widar3数据集上跨域识别准确率97.61%,优于现有方法。
无线信号除通信外还可用于环境感知。相较于其他感知介质,WiFi信号具备普及性高、硬件成本低及对光照、温湿度等环境因素鲁棒性强的优势。通过分析环境中的WiFi信号,可捕捉人体动态变化,实现手势识别等感知应用。然而,现有方案大多仅在训练域表现良好,缺乏跨域适应能力。为此,本文从所有接收端的信道状态信息(CSI)中提取多普勒谱,并沿时间轴拼接形成包含多视角信息的融合图像作为输入。进一步受卷积块注意力模块(CBAM)启发,提出一种集成多语义空间注意力与自注意力通道机制的识别网络,构建注意力图以量化图像中手势的时空特征,从而提取关键的域无关特征。同时采用ResNet18作为主干网络,进一步捕获深层特征。在公开的Widar3数据集上评估,该网络不仅保持了99.72%的域内识别准确率,跨域识别准确率也达到97.61%,显著优于现有最优方案。
原文摘要 · Abstract (English)
While fulfilling communication tasks, wireless signals can also be used to sense the environment. Among various types of sensing media, WiFi signals offer advantages such as widespread availability, low hardware cost, and strong robustness to environmental conditions like light, temperature, and humidity. By analyzing Wi-Fi signals in the environment, it is possible to capture dynamic changes of the human body and accomplish sensing applications such as gesture recognition. Although many existing gesture sensing solutions perform well in-domain but lack cross-domain capabilities (i.e., recognition performance in untrained environments). To address this, we extract Doppler spectra from the channel state information (CSI) received by all receivers and concatenate each Doppler spectrum along the same time axis to generate fused images with multi-angle information as input features. Furthermore, inspired by the convolutional block attention module (CBAM), we propose a gesture recognition network that integrates a multi-semantic spatial attention mechanism with a self-attention-based channel mechanism. This network constructs attention maps to quantify the spatiotemporal features of gestures in images, enabling the extraction of key domain-independent features. Additionally, ResNet18 is employed as the backbone network to further capture deep-level features. To validate the network performance, we evaluate the proposed network on the public Widar3 dataset, and the results show that it not only maintains high in-domain accuracy of 99.72%, but also achieves high performance in cross-domain recognition of 97.61%, significantly outperforming existing best solutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。