用语义引导生成高保真激光雷达点云,提升自动驾驶数据训练效果。
SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion
- 通过潜空间对齐实现语义标签到点云的精准生成
- 在真实场景下生成点云质量超越现有扩散模型
- 支持跨域翻译,适合自动驾驶感知系统数据增强
基于生成模型的激光雷达点云合成为深度学习流水线提供了有效解决方案,尤其在真实数据稀缺或多样性不足时。现有方法多关注无条件生成,忽视实际应用潜力。本文提出SG-LDM,一种语义引导的激光雷达扩散模型,通过潜空间对齐实现从语义标签到激光雷达点云的鲁棒生成。该模型直接在原始激光雷达空间操作,并利用显式语义条件,显著提升生成点云的保真度。此外,我们首次构建基于SG-LDM的扩散式激光雷达跨域翻译框架,作为领域自适应策略,进一步提升下游感知性能。系统实验表明,SG-LDM在生成质量上优于现有激光雷达扩散模型,且所提翻译框架在激光雷达分割任务中强化了数据增强效果。
原文摘要 · Abstract (English)
Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis approach can significantly enrich training datasets and enhance discriminative models. However, existing methods focus on unconditional lidar point cloud generation, overlooking their potential for real-world applications. In this paper, we propose SG-LDM, a Semantic-Guided Lidar Diffusion Model that employs latent alignment to enable robust semantic-to-lidar synthesis. By directly operating in the native lidar space and leveraging explicit semantic conditioning, SG-LDM achieves state-of-the-art performance in generating high-fidelity lidar point clouds guided by semantic labels. Moreover, we propose the first diffusion-based lidar translation framework based on SG-LDM, which enables cross-domain translation as a domain adaptation strategy to enhance downstream perception performance. Systematic experiments demonstrate that SG-LDM significantly outperforms existing lidar diffusion models and the proposed lidar translation framework further improves data augmentation performance in the downstream lidar segmentation task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。