arXiv:2410.11628cs.CV2024-10

通过多视角几何约束,实现更精准的激光雷达点云增强。

Simultaneous Diffusion Sampling for Conditional LiDAR Generation

  • 将输入点云转换为多个视角的合成扫描,联合生成增强结果。
  • 在多个基准测试中显著超越现有方法,生成更符合几何结构的点云。
  • 适合自动驾驶中点云稀疏或遮挡场景的重建任务。

激光雷达能捕捉反映周围环境几何结构的三维点云,是自动驾驶系统的核心传感器。当激光雷达扫描过于稀疏、被障碍物遮挡或探测范围过小时,如何在保持场景几何一致性的同时增强点云,对下游任务至关重要。受视觉生成方法兴起的启发,条件化激光雷达点云生成逐渐成为研究热点。本文提出一种新颖的同步扩散采样方法,通过引入多视角几何约束,利用视间互信息提升生成效果。具体地,将输入点云重投影至围绕该点云的多个新视角,生成多个合成激光雷达扫描;随后,合成与原始扫描同步进行条件生成。实验表明,该方法能生成精确且几何一致的点云增强结果,在多个基准测试中显著优于现有方法。

原文摘要 · Abstract (English)

By enabling capturing of 3D point clouds that reflect the geometry of the immediate environment, LiDAR has emerged as a primary sensor for autonomous systems. If a LiDAR scan is too sparse, occluded by obstacles, or too small in range, enhancing the point cloud scan by while respecting the geometry of the scene is useful for downstream tasks. Motivated by the explosive growth of interest in generative methods in vision, conditional LiDAR generation is starting to take off. This paper proposes a novel simultaneous diffusion sampling methodology to generate point clouds conditioned on the 3D structure of the scene as seen from multiple views. The key idea is to impose multi-view geometric constraints on the generation process, exploiting mutual information for enhanced results. Our method begins by recasting the input scan to multiple new viewpoints around the scan, thus creating multiple synthetic LiDAR scans. Then, the synthetic and input LiDAR scans simultaneously undergo conditional generation according to our methodology. Results show that our method can produce accurate and geometrically consistent enhancements to point cloud scans, allowing it to outperform existing methods by a large margin in a variety of benchmarks.

点云生成激光雷达扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。