arXiv:2512.12013cs.CVcs.LG2025-12

用星形图建模毫米波雷达点云,提升人体动作识别精度

Exploring Spatial-Temporal Representation via Star Graph for mmWave Radar-based Human Activity Recognition

  • 设计星形图捕捉静态中心点与动态雷达点的时空关系
  • 在真实数据集上达94.27%准确率,接近视觉骨架数据表现
  • 轻量级结构适合树莓派等资源受限设备部署

人体动作识别需提取精准的时空特征。基于毫米波雷达点云的系统因信号物理特性存在稀疏性和帧大小不一问题。现有方法多借用视觉密集点云的预处理流程,未必适用于毫米波雷达。本文提出一种离散动态图神经网络(DDGNN)与星形图表示相结合的方法,通过人工添加的静态中心点与连续帧中动态雷达点构建高维相对关系图,进而利用DDGNN学习可变尺寸星形图中的特征。实验表明,该方法在真实世界动作识别数据集上达到94.27%的整体分类准确率,接近基于视觉骨架数据的97.25%最优表现。在树莓派4上进行推理测试,验证了其在资源受限平台的有效性。此外,我们进行了全面的消融实验,验证模型设计合理性,且无需重采样或帧聚合器,优于三种近期雷达专用方法。

原文摘要 · Abstract (English)

Human activity recognition (HAR) requires extracting accurate spatial-temporal features with human movements. A mmWave radar point cloud-based HAR system suffers from sparsity and variable-size problems due to the physical features of the mmWave signal. Existing works usually borrow the preprocessing algorithms for the vision-based systems with dense point clouds, which may not be optimal for mmWave radar systems. In this work, we proposed a graph representation with a discrete dynamic graph neural network (DDGNN) to explore the spatial-temporal representation of human movement-related features. Specifically, we designed a star graph to describe the high-dimensional relative relationship between a manually added static center point and the dynamic mmWave radar points in the same and consecutive frames. We then adopted DDGNN to learn the features residing in the star graph with variable sizes. Experimental results demonstrated that our approach outperformed other baseline methods using real-world HAR datasets. Our system achieved an overall classification accuracy of 94.27\%, which gets the near-optimal performance with a vision-based skeleton data accuracy of 97.25\%. We also conducted an inference test on Raspberry Pi~4 to demonstrate its effectiveness on resource-constraint platforms. \sh{ We provided a comprehensive ablation study for variable DDGNN structures to validate our model design. Our system also outperformed three recent radar-specific methods without requiring resampling or frame aggregators.

毫米波雷达动作识别图神经网络星形图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。