arXiv:2601.14208cs.CVcs.GR2026-01ICML被引 2

用三相机架拍底盘,自动生成可交互的3D模型,一眼看清隐患。

Rig-Aware 3D Reconstruction of Vehicle Undercarriages using Gaussian Splatting

  • 用校准相机架+同步视频流,解决广角畸变和视差小难题
  • 通过特征匹配生成高质量稀疏点云,支撑真实感建模
  • 生成可旋转缩放的实时渲染3D模型,适合质检与二手车展示

检查二手车辆底盘是一项费力的工作,需工作人员蹲下或爬行观察,且线上买家很少能看到底盘照片。本文提出一种端到端流程,利用三相机架在车辆驶过时拍摄底盘视频,并生成可交互的3D模型。该模型支持旋转、缩放和剖切,帮助检测锈蚀、漏油或撞击损伤,显著提升作业安全与买家信心。核心贡献是专为应对广角镜头畸变和低视差场景设计的相机架感知结构光从运动(SfM)流程。方法融合精确相机标定、同步视频流及相机架的强几何先验,采用带约束的匹配策略,结合DISK特征提取器与基于注意力的LightGlue匹配器,生成高质量稀疏点云,传统SfM难以实现。这些点云作为高斯点阵法输入,生成可实时渲染的逼真底盘模型。实验与消融研究证明设计选择对达到当前最优质量至关重要。

原文摘要 · Abstract (English)

Inspecting the undercarriage of used vehicles is a labor-intensive task that requires inspectors to crouch or crawl underneath each vehicle to thoroughly examine it. Additionally, online buyers rarely see undercarriage photos. We present an end-to-end pipeline that utilizes a three-camera rig to capture videos of the undercarriage as the vehicle drives over it, and produces an interactive 3D model of the undercarriage. The 3D model enables inspectors and customers to rotate, zoom, and slice through the undercarriage, allowing them to detect rust, leaks, or impact damage in seconds, thereby improving both workplace safety and buyer confidence. Our primary contribution is a rig-aware Structure-from-Motion (SfM) pipeline specifically designed to overcome the challenges of wide-angle lens distortion and low-parallax scenes. Our method overcomes the challenges of wide-angle lens distortion and low-parallax scenes by integrating precise camera calibration, synchronized video streams, and strong geometric priors from the camera rig. We use a constrained matching strategy with learned components, the DISK feature extractor, and the attention-based LightGlue matcher to generate high-quality sparse point clouds that are often unattainable with standard SfM pipelines. These point clouds seed the Gaussian splatting process to generate photorealistic undercarriage models that render in real-time. Our experiments and ablation studies demonstrate that our design choices are essential to achieve state-of-the-art quality.

3D重建视觉测量汽车检测高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。