用三视图重建3D CAD模型,无需向量图和真实3D数据。
GaussianCAD: Robust Self-Supervised CAD Reconstruction from Three Orthographic Views Using 3D Gaussian Splatting
- 将三视图转为类自然图像并手动设定相机位姿,实现精准对齐
- 在Sub-Fusion360上性能超越现有方法,抗噪声能力强
- 自监督设计适合工业场景,减少对标注数据依赖
从CAD草图自动重建3D计算机辅助设计(CAD)模型近年来在计算机视觉领域受到广泛关注。然而,现有方法通常依赖于矢量CAD草图和3D真实标签进行监督,这些数据在工业应用中难以获取且对噪声敏感。本文将CAD重建视为一种稀疏视角3D重建的特例,以克服上述局限。尽管这一重构视角前景广阔,但现有3D重建方法通常需要自然图像和对应相机位姿作为输入,带来两大挑战:(1)CAD草图与自然图像之间的模态差异;(2)对CAD草图进行精确相机位姿估计困难。为解决这些问题,我们首先将CAD草图转换为类似自然图像的表示并提取对应掩码;接着手动计算正交视图的相机位姿,确保在3D坐标系中的准确对齐;最后采用定制化的稀疏视角3D重建方法,从对齐后的正交视图实现高质量重建。通过使用光栅化CAD草图进行自监督,本方法摆脱了对矢量草图和3D真实标签的依赖。在Sub-Fusion360数据集上的实验表明,所提方法显著优于先前方法,在噪声输入下表现出强鲁棒性。
原文摘要 · Abstract (English)
The automatic reconstruction of 3D computer-aided design (CAD) models from CAD sketches has recently gained significant attention in the computer vision community. Most existing methods, however, rely on vector CAD sketches and 3D ground truth for supervision, which are often difficult to be obtained in industrial applications and are sensitive to noise inputs. We propose viewing CAD reconstruction as a specific instance of sparse-view 3D reconstruction to overcome these limitations. While this reformulation offers a promising perspective, existing 3D reconstruction methods typically require natural images and corresponding camera poses as inputs, which introduces two major significant challenges: (1) modality discrepancy between CAD sketches and natural images, and (2) difficulty of accurate camera pose estimation for CAD sketches. To solve these issues, we first transform the CAD sketches into representations resembling natural images and extract corresponding masks. Next, we manually calculate the camera poses for the orthographic views to ensure accurate alignment within the 3D coordinate system. Finally, we employ a customized sparse-view 3D reconstruction method to achieve high-quality reconstructions from aligned orthographic views. By leveraging raster CAD sketches for self-supervision, our approach eliminates the reliance on vector CAD sketches and 3D ground truth. Experiments on the Sub-Fusion360 dataset demonstrate that our proposed method significantly outperforms previous approaches in CAD reconstruction performance and exhibits strong robustness to noisy inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。