arXiv:2507.23683cs.CV2025-07

用道路基础设施视角生成车载视角数据,提升自动驾驶训练素材质量。

I2V-GS: Infrastructure-to-Vehicle View Transformation with Gaussian Splatting for Autonomous Driving Data Generation

  • 基于高斯点云的视图转换,从道路设施图像生成车辆视角画面。
  • 合成效果优于现有方法,三项指标提升超14%以上。
  • 适合需要高质量自动驾驶数据集的研究者与工程师使用。

大规模高质量数据对端到端自动驾驶系统至关重要,但当前数据多依赖车载采集,成本高且效率低。本文提出I2V-GS方法,通过高斯点云实现从基础设施视角到车辆视角的视图转换。针对稀疏基础设施视角重建与大角度视图变换难题,采用自适应深度扭曲生成密集训练视图,并引入级联填充策略扩展视图范围,确保跨视图内容一致性。为增强扩散模型可靠性,利用跨视图信息进行置信度引导优化。同时构建了真实场景下的多模态、多视角数据集RoadSight。实验表明,I2V-GS在车辆视角合成质量上显著优于StreetGaussian,NTA-Iou、NTL-Iou和FID分别提升45.7%、34.2%和14.9%。

原文摘要 · Abstract (English)

Vast and high-quality data are essential for end-to-end autonomous driving systems. However, current driving data is mainly collected by vehicles, which is expensive and inefficient. A potential solution lies in synthesizing data from real-world images. Recent advancements in 3D reconstruction demonstrate photorealistic novel view synthesis, highlighting the potential of generating driving data from images captured on the road. This paper introduces a novel method, I2V-GS, to transfer the Infrastructure view To the Vehicle view with Gaussian Splatting. Reconstruction from sparse infrastructure viewpoints and rendering under large view transformations is a challenging problem. We adopt the adaptive depth warp to generate dense training views. To further expand the range of views, we employ a cascade strategy to inpaint warped images, which also ensures inpainting content is consistent across views. To further ensure the reliability of the diffusion model, we utilize the cross-view information to perform a confidenceguided optimization. Moreover, we introduce RoadSight, a multi-modality, multi-view dataset from real scenarios in infrastructure views. To our knowledge, I2V-GS is the first framework to generate autonomous driving datasets with infrastructure-vehicle view transformation. Experimental results demonstrate that I2V-GS significantly improves synthesis quality under vehicle view, outperforming StreetGaussian in NTA-Iou, NTL-Iou, and FID by 45.7%, 34.2%, and 14.9%, respectively.

自动驾驶视图生成高斯点云数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。