基于场景约束的点云实例补全,提升室内物体补全精度与合理性
Point-based Instance Completion with Scene Constraints
- 引入场景点云约束,通过交叉注意力融合场景信息进行补全
- 在新构建的ScanWCF数据集上,补全结果更贴近真实扫描,无碰撞且封闭
- 适用于任意尺度和姿态的物体,适合复杂室内场景重建
近期基于点云的物体补全方法能准确恢复部分观测物体的缺失几何结构。然而,这些方法不考虑场景中已知的约束(如其他表面),且要求输入为规范坐标系,这在真实场景中难以满足。尽管已有实例场景补全方法,但其补全质量仍逊于点云物体补全方法,且未充分利用场景约束。为此,本文提出一种基于点云的实例补全模型,可鲁棒地完成任意尺度与姿态下的物体补全。为实现场景级推理,我们以点云形式表示稀疏场景约束,并通过交叉注意力机制融入补全模型。为进一步评估室内场景中的实例补全任务,我们构建了新数据集ScanWCF,包含标注的部分扫描及对齐的真实完整场景补全结果,要求补全后模型水密且无碰撞。实验表明,该方法在保持对部分扫描高保真度的同时,显著提升了补全质量与合理性,优于现有最先进方法。
原文摘要 · Abstract (English)
Recent point-based object completion methods have demonstrated the ability to accurately recover the missing geometry of partially observed objects. However, these approaches are not well-suited for completing objects within a scene, as they do not consider known scene constraints (e.g., other observed surfaces) in their completions and further expect the partial input to be in a canonical coordinate system, which does not hold for objects within scenes. While instance scene completion methods have been proposed for completing objects within a scene, they lag behind point-based object completion methods in terms of object completion quality and still do not consider known scene constraints during completion. To overcome these limitations, we propose a point cloud-based instance completion model that can robustly complete objects at arbitrary scales and pose in the scene. To enable reasoning at the scene level, we introduce a sparse set of scene constraints represented as point clouds and integrate them into our completion model via a cross-attention mechanism. To evaluate the instance scene completion task on indoor scenes, we further build a new dataset called ScanWCF, which contains labeled partial scans as well as aligned ground truth scene completions that are watertight and collision-free. Through several experiments, we demonstrate that our method achieves improved fidelity to partial scans, higher completion quality, and greater plausibility over existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。