用3D高斯点云实现单视角汽车损伤精准分割,提升保险定损效率。
CrashSplat: 2D to 3D Vehicle Damage Segmentation in Gaussian Splatting
- 基于3D高斯溅射技术,将2D损伤掩码升维至3D空间进行分割
- 仅需单张图像即可完成分割,对小损伤在特定视角更有效
- 无需训练,适合保险定损等实际场景快速部署
自动汽车损伤检测对汽车保险行业具有重要意义,可实现更快、更准确且成本更低的评估。然而,现有方法多局限于2D图像分析,较少利用3D重建技术来获得更全面、几何精确的损伤表征。近年来,基于3D表示的新视角合成方法,特别是3D高斯溅射(3D-GS),已证明可从少量视图中生成准确连贯的3D重建。本文提出一种全自动汽车损伤检测流程,通过上采样2D掩码实现3D损伤分割。此外,我们设计了一种简单有效的无学习单视图3D-GS分割方法:利用结构光恢复(SfM)获取的相机参数将高斯体投影到图像平面,并通过Z缓冲与深度及透明度的正态分布模型进行过滤。实验表明,该方法在挑战性场景下表现优异,如损伤(如划痕、小凹陷)仅在单一视角清晰可见时,多视角一致性方法难以应用。代码已开源:https://github.com/DragosChileban/CrashSplat。
原文摘要 · Abstract (English)
Automatic car damage detection has been a topic of significant interest for the auto insurance industry as it promises faster, accurate, and cost-effective damage assessments. However, few works have gone beyond 2D image analysis to leverage 3D reconstruction methods, which have the potential to provide a more comprehensive and geometrically accurate representation of the damage. Moreover, recent methods employing 3D representations for novel view synthesis, particularly 3D Gaussian Splatting (3D-GS), have demonstrated the ability to generate accurate and coherent 3D reconstructions from a limited number of views. In this work we introduce an automatic car damage detection pipeline that performs 3D damage segmentation by up-lifting 2D masks. Additionally, we propose a simple yet effective learning-free approach for single-view 3D-GS segmentation. Specifically, Gaussians are projected onto the image plane using camera parameters obtained via Structure from Motion (SfM). They are then filtered through an algorithm that utilizes Z-buffering along with a normal distribution model of depth and opacities. Through experiments we found that this method is particularly effective for challenging scenarios like car damage detection, where target objects (e.g., scratches, small dents) may only be clearly visible in a single view, making multi-view consistency approaches impractical or impossible. The code is publicly available at: https://github.com/DragosChileban/CrashSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。