用语义掩码引导编辑真实激光雷达数据,生成逼真复杂场景。
Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing
- 将点云转为范围图像,用凸包语义掩码指导编辑
- 在KITTI-360上生成高质量动态与边缘场景点云
- 适合自动驾驶数据增强,提升系统鲁棒性
训练自动驾驶与导航系统需要大规模且多样化的点云数据集,以覆盖各种动态城市环境中的复杂边缘案例。从真实世界点云中获取此类多样化场景,尤其是关键边缘情况,具有挑战性,限制了系统的泛化与鲁棒性。现有方法依赖于在手工设计的3D虚拟环境中模拟点云数据,耗时且计算成本高,常无法充分捕捉真实场景的复杂性。本文提出一种新方法,通过语义掩码引导编辑真实激光雷达扫描,生成新型合成点云。结合范围图像投影与语义掩码条件,实现基于扩散模型的生成。点云被转换为2D范围视图图像,作为中间表示,使用基于凸包的语义掩码进行语义编辑。这些掩码提供物体尺寸、方向与位置信息,确保几何一致性与真实性。该方法在KITTI-360数据集上验证,能生成高质量点云,涵盖复杂边缘案例与动态场景,为生成多样化激光雷达数据提供低成本、可扩展的解决方案,助力提升自动驾驶系统的鲁棒性。
原文摘要 · Abstract (English)
Training autonomous driving and navigation systems requires large and diverse point cloud datasets that capture complex edge case scenarios from various dynamic urban settings. Acquiring such diverse scenarios from real-world point cloud data, especially for critical edge cases, is challenging, which restricts system generalization and robustness. Current methods rely on simulating point cloud data within handcrafted 3D virtual environments, which is time-consuming, computationally expensive, and often fails to fully capture the complexity of real-world scenes. To address some of these issues, this research proposes a novel approach that addresses the problem discussed by editing real-world LiDAR scans using semantic mask-based guidance to generate novel synthetic LiDAR point clouds. We incorporate range image projection and semantic mask conditioning to achieve diffusion-based generation. Point clouds are transformed to 2D range view images, which are used as an intermediate representation to enable semantic editing using convex hull-based semantic masks. These masks guide the generation process by providing information on the dimensions, orientations, and locations of objects in the real environment, ensuring geometric consistency and realism. This approach demonstrates high-quality LiDAR point cloud generation, capable of producing complex edge cases and dynamic scenes, as validated on the KITTI-360 dataset. This offers a cost-effective and scalable solution for generating diverse LiDAR data, a step toward improving the robustness of autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。