arXiv:2411.19251eess.IVcs.CV2024-11被引 1

用双毫米波雷达+双视角CNN实现老人跌倒检测,保护隐私且实时性好。

Skeleton Detection Using Dual Radars with Integration of Dual-View CNN Models and mmPose

  • 双雷达融合点云数据,结合PointNet与mmPose处理旋转平移不变性与局部特征
  • 在手臂摆动场景下,平均绝对误差(MAE)表现优异,随机行走时效果较弱
  • 适合养老监护、智能家居等注重隐私的实时动作追踪场景

骨骼检测可应用于多种场景,尤其在老年人实时跌倒检测中至关重要。相比传统图像处理,利用毫米波雷达采集的点云数据更注重隐私保护,提供非侵入式安全监控方案。处理点云需应对三个关键挑战:第一,通过融合PointNet与mmPose模型解决点云的旋转、平移不变性及局部性问题;第二,因单帧点数有限,采用双雷达数据融合提升骨骼检测精度;第三,输入学习模型时使用坐标、速度和信噪比(SNR)等特征,缓解稀疏性并降低计算负担。本研究提出三种双视角CNN模型,结合PointNet与mmPose,使用两台mmWave雷达,并以平均绝对误差(MAE)进行性能对比。结果显示,模型在手臂摆动场景表现良好,随机行走时效果较差。

原文摘要 · Abstract (English)

Skeleton detection is a technique that can beapplied to a variety of situations. It is especially critical identifying and tracking the movements of the elderly, especially in real-time fall detection. While conventional image processing methods exist, there's a growing preference for utilizing pointclouds data collected by mmWave radars from viewpoint of privacy protection, offering a non-intrusive approach to elevatesafety and care for the elderly. Dealing with point cloud data necessitates addressing three critical considerations. Firstly, the inherent nature of point clouds -- rotation invariance, translation invariance, and locality -- is managed through the fusion of PointNet and mmPose. PointNet ensures rotational and translational invariance, while mmPose addresses locality. Secondly, the limited points per frame from radar require data integration from two radars to enhance skeletal detection. Lastly,inputting point cloud data into the learning model involves utilizing features like coordinates, velocity, and signal-to-noise ratio (SNR) per radar point to mitigate sparsity issues and reduce computational load. This research proposes three Dual ViewCNN models, combining PointNet and mmPose, employing two mmWave radars, with performance comparisons in terms of Mean Absolute Error (MAE). While the proposed model shows suboptimal results for random walking, it excels in the arm swing case.

骨骼检测毫米波雷达隐私保护老年监护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。