arXiv:2602.04436cs.LG2026-02

用雷达信号识别手势,用脉冲神经网络实现低功耗高效识别

Hand Gesture Recognition from Doppler Radar Signals Using Echo State Networks

  • 采用回声状态网络处理雷达时频特征图,构建轻量级手势识别模型
  • 在Soli数据集上11类手势识别准确率达97.3%,比深度学习模型更快
  • 适合车载、机器人等资源受限场景,计算成本仅为传统方法的1/5

手部手势识别(HGR)是人机交互(HCI)的关键技术。基于调频连续波(FMCW)雷达信号的HGR适用于车载界面和机器人系统,需轻量且计算高效的识别方法。现有深度学习方法仍存在高计算开销问题。本文提出一种基于回声状态网络(ESN)的雷达手势识别方法,将原始雷达数据转换为距离-时间、多普勒-时间等特征图,输入一个或多个基于循环神经网络的储备池。通过岭回归、支持向量机和随机森林等读出分类器处理储备池状态。对比实验表明,该方法在Soli数据集上的11类手势任务中表现优于现有方法,在Dop-NET数据集的4类任务中也超越了现有深度学习模型。结果表明,使用多储备池并行处理不同特征图,在时空与时频域中有效捕捉时间模式。所提方法在保持高识别性能的同时具备极低的计算成本,适用于资源受限环境中的先进人机交互技术。

原文摘要 · Abstract (English)

Hand gesture recognition (HGR) is a fundamental technology in human computer interaction (HCI).In particular, HGR based on Doppler radar signals is suited for in-vehicle interfaces and robotic systems, necessitating lightweight and computationally efficient recognition techniques. However, conventional deep learning-based methods still suffer from high computational costs. To address this issue, we propose an Echo State Network (ESN) approach for radar-based HGR, using frequency-modulated-continuous-wave (FMCW) radar signals. Raw radar data is first converted into feature maps, such as range-time and Doppler-time maps, which are then fed into one or more recurrent neural network-based reservoirs. The obtained reservoir states are processed by readout classifiers, including ridge regression, support vector machines, and random forests. Comparative experiments demonstrate that our method outperforms existing approaches on an 11-class HGR task using the Soli dataset and surpasses existing deep learning models on a 4-class HGR task using the Dop-NET dataset. The results indicate that parallel processing using multi-reservoir ESNs are effective for recognizing temporal patterns from the multiple different feature maps in the time-space and time-frequency domains. Our ESN approaches achieve high recognition performance with low computational cost in HGR, showing great potential for more advanced HCI technologies, especially in resource-constrained environments.

手势识别雷达感知轻量模型边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。