用补全辅助对齐室内物体与CAD模型,提升真实扫描下的精度
CAOA -- Completion-Assisted Object-CAD Alignment

- 结合语义补全与对称感知的相对位姿估计,实现高精度对齐
- 在Scan2CAD上相比顶尖方法提升17%对齐准确率
- 新数据集S2C-Completion支持真实场景单物体补全任务
精确对齐室内RGB-D扫描中的物体与对应的CAD模型是3D语义重建的核心挑战。该任务需估计9自由度(位置、旋转及三轴缩放)位姿,但受噪声和不完整扫描以及分割错误导致的几何畸变影响。本文提出完成辅助物体-CAD对齐方法(CAOA),将语义与上下文感知的点云补全模块与对称感知的相对位姿估计算法结合,实现对齐精度提升。现有补全方法多在合成数据集上训练评估,难以泛化至真实扫描。为此,我们设计针对室内场景的合成数据生成策略,显著缩小了合成到真实的域差距,经多个主流补全数据集量化验证。此外,我们发布S2C-Completion数据集,包含超过8500个来自Scan2CAD的物体-CAD配对,专为真实室内单物体补全任务设计,可作为新基准。通过引入对称性感知损失,增强对称模糊性的鲁棒性。在Scan2CAD基准上,CAOA相较现有最优方法提升17%对齐准确率。
原文摘要 · Abstract (English)
Accurately aligning CAD models to their corresponding objects in indoor RGB-D scans is a central challenge in 3D semantic reconstruction. The task requires estimating a 9-Degree-of-Freedom (DoF) pose-position, rotation, and scale along three axes-but is hindered by noisy and incomplete scans, as well as segmentation errors that cause geometric distortions. We present Completion-Assisted Object-CAD Alignment (CAOA), a method that integrates a semantically and contextually aware point cloud completion module with a symmetry-aware relative pose estimation algorithm, enabling precise alignment of CAD models to scanned objects. Existing completion methods are typically trained and evaluated on synthetic datasets, which often fail to generalize to real-world scans. To bridge this gap, we introduce a synthetic data generation strategy tailored to indoor scenes, significantly reducing the synthetic-to-real domain gap-validated through quantitative comparisons with widely used completion datasets. In addition, we release S2C-Completion, an expert-annotated dataset of over 8,500 object-CAD pairs from Scan2CAD, created for real-world indoor single-object completion and intended as a new benchmark for this task. For object-CAD alignment, we incorporate symmetry information via a symmetry-aware loss, improving robustness to symmetric ambiguities. On the Scan2CAD benchmark, CAOA achieves a 17% accuracy improvement over state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。