arXiv:2412.08326cs.CV2024-12中稿 · AAAI被引 4

挖掘点云局部与全局上下文信息,提升补全细节保真度。

Digging into Intrinsic Contextual Information for High-fidelity 3D Point Cloud Completion

  • 细阶段引入局部上下文与全局几何相似性建模
  • 在真实数据集上实现比现有方法更高的细节还原度
  • 适合需要高保真点云重建的3D视觉任务

点云因遮挡导致不完整是几何处理中的常见问题,点云补全(PCC)因此备受关注。现有方法通常采用从粗到细的范式:粗阶段生成整体形状,细阶段优化纹理细节。尽管扩散模型在粗阶段表现良好,但细阶段仍因任务病态性难以生成高保真结果。本文提出一种高保真点云补全方法,深入挖掘部分点云中的短程与长程上下文信息。在扩散模型生成粗略点云后,混合采样模块将局部上下文信息引入细阶段;表面冻结模块保护无噪声部分点云免受干扰;同时设计相似性建模模块,在刚性变换不变性下建立点间全局几何流形特征匹配。由此,部分点云中的高质量成分可作为参考,精细重构粗略点云。大量实验表明,该方法优于当前最优(SOTA)方法。代码已公开于https://github.com/JS-CHU/ContextualCompletion。

原文摘要 · Abstract (English)

The common occurrence of occlusion-induced incompleteness in point clouds has made point cloud completion (PCC) a highly-concerned task in the field of geometric processing. Existing PCC methods typically produce complete point clouds from partial point clouds in a coarse-to-fine paradigm, with the coarse stage generating entire shapes and the fine stage improving texture details. Though diffusion models have demonstrated effectiveness in the coarse stage, the fine stage still faces challenges in producing high-fidelity results due to the ill-posed nature of PCC. The intrinsic contextual information for texture details in partial point clouds is the key to solving the challenge. In this paper, we propose a high-fidelity PCC method that digs into both short and long-range contextual information from the partial point cloud in the fine stage. Specifically, after generating the coarse point cloud via a diffusion-based coarse generator, a mixed sampling module introduces short-range contextual information from partial point clouds into the fine stage. A surface freezing modules safeguards points from noise-free partial point clouds against disruption. As for the long-range contextual information, we design a similarity modeling module to derive similarity with rigid transformation invariance between points, conducting effective matching of geometric manifold features globally. In this way, the high-quality components present in the partial point cloud serve as valuable references for refining the coarse point cloud with high fidelity. Extensive experiments have demonstrated the superiority of the proposed method over SOTA competitors. Our code is available at https://github.com/JS-CHU/ContextualCompletion.

点云补全上下文信息高保真扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。