用修正代替生成,让3D点云补全更准确
Rethinking Multimodal Point Cloud Completion: A Completion-by-Correction Perspective
- 先用图像生成完整形状,再在特征空间修正对齐
- 相比顶尖方法,误差降低23.5%,完整度提升7.1%
- 适合需要高结构一致性的3D重建场景
点云补全旨在从部分观测中重构完整的3D形状,由于严重遮挡和几何缺失,该任务极具挑战。尽管多模态技术利用互补的RGB图像弥补缺失几何信息,但多数方法仍采用基于填充的生成范式,从融合的潜在特征中合成缺失结构。我们实证表明,该范式常因几何与语义约束不足导致结构不一致和拓扑伪影。为此,我们重新思考任务,提出更稳健的“基于修正”的新范式:以预训练的图像到3D模型生成拓扑完整的形状先验,并在特征空间中进行修正以对齐局部观测。该范式将补全从无约束生成转变为有指导的精修,实现结构一致且观测对齐的重建。在此基础上,我们提出PGNet,一个分阶段框架,通过双特征编码锚定生成先验,合成粗略但结构对齐的骨架,并通过层级修正逐步精细化几何细节。在ShapeNetViPC数据集上的实验表明,相较于现有最先进方法,PGNet在平均切比雪夫距离上降低23.5%,F-score提升7.1%。
原文摘要 · Abstract (English)
Point cloud completion aims to reconstruct complete 3D shapes from partial observations, which is a challenging problem due to severe occlusions and missing geometry. Despite recent advances in multimodal techniques that leverage complementary RGB images to compensate for missing geometry, most methods still follow a Completion-by-Inpainting paradigm, synthesizing missing structures from fused latent features. We empirically show that this paradigm often results in structural inconsistencies and topological artifacts due to limited geometric and semantic constraints. To address this, we rethink the task and propose a more robust paradigm, termed Completion-by-Correction, which begins with a topologically complete shape prior generated by a pretrained image-to-3D model and performs feature-space correction to align it with the partial observation. This paradigm shifts completion from unconstrained synthesis to guided refinement, enabling structurally consistent and observation-aligned reconstruction. Building upon this paradigm, we introduce PGNet, a multi-stage framework that conducts dual-feature encoding to ground the generative prior, synthesizes a coarse yet structurally aligned scaffold, and progressively refines geometric details via hierarchical correction. Experiments on the ShapeNetViPC dataset demonstrate the superiority of PGNet over state-of-the-art baselines in terms of average Chamfer Distance (-23.5%) and F-score (+7.1%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。