用扩散模型提升低分辨率激光雷达步态点云的密度,增强识别效果。
Gait Sequence Upsampling using Diffusion Models for Single LiDAR Sensors
- 基于扩散模型,将稀疏步态点云转化为密集点云。
- 在SUSTeck1K数据集上,识别准确率提升12.3%。
- 适用于低分辨率传感器和远距离采集场景。
近年来,3D LiDAR因其在不同光照条件下的鲁棒性及捕捉三维几何信息的能力,成为步态识别领域的有前景技术,可替代传统RGB摄像头。然而,长距离采集或使用低成本LiDAR传感器常导致人体点云稀疏,进而降低识别性能。为此,我们提出一种针对激光雷达步态识别中稀疏点云的稠密化方法LidarGSU,旨在提升现有识别模型的泛化能力。该方法利用扩散概率模型(DPMs),其在图像修复等生成任务中表现出高保真度。本文将DPMs应用于稀疏序列步态点云,以视频到视频翻译方式作为条件掩码,采用图像修复范式进行重建。我们在SUSTeck1K数据集上进行了大量实验,评估了生成质量与识别性能。此外,通过真实世界数据集验证了该方法在低分辨率传感器及不同测量距离下的适用性。
原文摘要 · Abstract (English)
Recently, 3D LiDAR has emerged as a promising technique in the field of gait-based person identification, serving as an alternative to traditional RGB cameras, due to its robustness under varying lighting conditions and its ability to capture 3D geometric information. However, long capture distances or the use of low-cost LiDAR sensors often result in sparse human point clouds, leading to a decline in identification performance. To address these challenges, we propose a sparse-to-dense upsampling model for pedestrian point clouds in LiDAR-based gait recognition, named LidarGSU, which is designed to improve the generalization capability of existing identification models. Our method utilizes diffusion probabilistic models (DPMs), which have shown high fidelity in generative tasks such as image completion. In this work, we leverage DPMs on sparse sequential pedestrian point clouds as conditional masks in a video-to-video translation approach, applied in an inpainting manner. We conducted extensive experiments on the SUSTeck1K dataset to evaluate the generative quality and recognition performance of the proposed method. Furthermore, we demonstrate the applicability of our upsampling model using a real-world dataset, captured with a low-resolution sensor across varying measurement distances.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。