arXiv:2603.26638cs.CVcs.RO2026-03

在杂乱车场中实现高保真车辆外表面三维重建,无需专业拍摄环境。

Drive-Through 3D Vehicle Exterior Reconstruction via Dynamic-Scene SfM and Distortion-Aware Gaussian Splatting

  • 用双相机系统结合动态遮蔽和语义分割,分离移动车辆与复杂背景。
  • 在未校正的4K图像上直接匹配特征,提升畸变和反光场景下的重建精度。
  • 通过畸变感知的高斯点云渲染,生成可交互的高质量3D模型,适合在线购车应用。

高保真车辆外观三维重建能增强在线汽车交易平台的用户信任,但在杂乱的经销商车道环境中实现这一目标面临严峻技术挑战。与静态场景摄影测量不同,该场景中车辆动态移动,背景高度杂乱且静止。问题进一步因广角镜头畸变、汽车漆面反光及非刚性轮子旋转而加剧,违反经典对极几何约束。本文提出一个端到端管道,采用双支柱相机装置:首先,通过SAM 3实例分割与运动门控相结合,清晰分离运动车辆,显式屏蔽非刚性车轮以强化对极几何;其次,利用RoMa v2学习匹配器,在原始畸变的4K图像上提取鲁棒对应关系,由语义置信度掩码引导;第三,将这些匹配整合进考虑相机阵列特性的SfM优化中,使用CAD提供的相对位姿先验消除尺度漂移;最后,采用畸变感知的3D高斯点云渲染框架(3DGUT)结合随机马尔可夫链蒙特卡洛(MCMC)密集化策略,渲染反射表面。在10家经销商的25辆真实车辆上评估显示,完整管道在保留视图上的PSNR达28.66 dB,SSIM为0.89,LPIPS为0.21,相比标准3D-GS提升3.85 dB,实现无需受控工作室环境的质检级交互式3D模型。

原文摘要 · Abstract (English)

High-fidelity 3D reconstruction of vehicle exteriors improves buyer confidence in online automotive marketplaces, but generating these models in cluttered dealership drive-throughs presents severe technical challenges. Unlike static-scene photogrammetry, this setting features a dynamic vehicle moving against heavily cluttered, static backgrounds. This problem is further compounded by wide-angle lens distortion, specular automotive paint, and non-rigid wheel rotations that violate classical epipolar constraints. We propose an end-to-end pipeline utilizing a two-pillar camera rig. First, we resolve dynamic-scene ambiguities by coupling SAM 3 for instance segmentation with motion-gating to cleanly isolate the moving vehicle, explicitly masking out non-rigid wheels to enforce strict epipolar geometry. Second, we extract robust correspondences directly on raw, distorted 4K imagery using the RoMa v2 learned matcher guided by semantic confidence masks. Third, these matches are integrated into a rig-aware SfM optimization that utilizes CAD-derived relative pose priors to eliminate scale drift. Finally, we use a distortion-aware 3D Gaussian Splatting framework (3DGUT) coupled with a stochastic Markov Chain Monte Carlo (MCMC) densification strategy to render reflective surfaces. Evaluations on 25 real-world vehicles across 10 dealerships demonstrate that our full pipeline achieves a PSNR of 28.66 dB, an SSIM of 0.89, and an LPIPS of 0.21 on held-out views, representing a 3.85 dB improvement over standard 3D-GS, delivering inspection-grade interactive 3D models without controlled studio infrastructure.

三维重建车辆建模高斯溅射动态场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。