arXiv:2410.02771cs.CVcs.AI2024-10

用全复数卷积网络提升雷达手势识别准确率

Complex-valued convolutional neural network classification of hand gesture from radar images

  • 构建全复数域卷积神经网络,支持复数前向与反向传播
  • 在两个雷达手势数据集上表现优于传统实数模型
  • 适合做雷达感知与低功耗人机交互的科研人员参考

过去十年,手势识别系统在人机交互领域取得显著进展,广泛应用于安全、汽车等多个场景。尽管已有多种深度神经网络架构被用于手势识别,包括多层感知机(MLP)、卷积神经网络(CNN)、循环神经网络(RNN)以及经典的CNN-RNN级联结构,但主流方法仍基于实数域(RV)。现有技术常将复数雷达图像转换为实数形式处理,如拆分实部与虚部,但这会使网络维度翻倍。研究表明,复数(CV)数值具有更强的表征能力,但由于缺乏完整的复数建模工具,复数网络性能受限。本文提出一个全复数卷积神经网络(CV-CNN),包含复数域内的所有运算与梯度计算模块。我们在两个复数域手势雷达图像数据集上对比了该模型与等效实数模型的性能。第五章进一步提出一种复数前向残差网络,用于二分类任务,并与所提CV-CNN及基线复数前向CNN进行比较。

原文摘要 · Abstract (English)

Hand gesture recognition systems have yielded many exciting advancements in the last decade and become more popular in HCI (human-computer interaction) with several application areas, which spans from safety and security applications to automotive field. Various deep neural network architectures have already been inspected for hand gesture recognition systems, including multi-layer perceptron (MLP), convolutional neural network (CNN), recurrent neural network (RNN) and a cascade of the last two architectures known as CNN-RNN. However, a major problem still exists, which is most of the existing ML algorithms are designed and developed the building blocks and techniques for real-valued (RV). Researchers applied various RV techniques on the complex-valued (CV) radar images, such as converting a CV optimisation problem into a RV one, by splitting the complex numbers into their real and imaginary parts. However, the major disadvantage of this method is that the resulting algorithm will double the network dimensions. Recent work on RNNs and other fundamental theoretical analysis suggest that CV numbers have a richer representational capacity, but due to the absence of the building blocks required to design such models, the performance of CV networks are marginalised. In this report, we propose a fully CV-CNN, including all building blocks, forward and backward operations, and derivatives all in complex domain. We explore our proposed classification model on two sets of CV hand gesture radar images in comparison with the equivalent RV model. In chapter five, we propose a CV-forward residual network, for the purpose of binary classification of the two sets of CV hand gesture radar datasets and compare its performance with our proposed CV-CNN and a baseline CV-forward CNN.

手势识别雷达感知复数网络卷积神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。