arXiv:2507.14485cs.CVcs.AI2025-07被引 1

用相似样本提升点云补全效果,让模型更懂结构先验。

Benefit from Reference: Retrieval-Augmented Cross-modal Point Cloud Completion

  • 引入跨模态检索,从参考样本中学习结构先验。
  • 在多个数据集上实现细粒度补全,稀疏和未见类别表现优异。
  • 适合需要鲁棒3D重建的工业与机器人场景应用。

基于不完整点云完成3D结构是一项挑战性任务,尤其当残缺点云缺乏典型结构特征时。现有基于跨模态学习的方法虽尝试引入实例图像辅助结构特征学习,但仍局限于特定输入类别,限制了生成能力。本文提出一种新颖的检索增强型点云补全框架。核心思想是将跨模态检索融入补全任务,从相似参考样本中学习结构先验信息。具体地,设计结构共享特征编码器(SSFE),联合提取跨模态特征并重构参考特征作为先验;通过编码器中的双通道控制门,增强参考样本中的相关结构特征,抑制无关信息干扰。此外,提出渐进式检索增强生成器(PRAG),采用分层特征融合机制,从全局到局部逐步整合参考先验与输入特征。在多个数据集和真实场景上的大量实验表明,该方法在生成细粒度点云方面表现有效,并具备处理稀疏数据和未见类别的泛化能力。

原文摘要 · Abstract (English)

Completing the whole 3D structure based on an incomplete point cloud is a challenging task, particularly when the residual point cloud lacks typical structural characteristics. Recent methods based on cross-modal learning attempt to introduce instance images to aid the structure feature learning. However, they still focus on each particular input class, limiting their generation abilities. In this work, we propose a novel retrieval-augmented point cloud completion framework. The core idea is to incorporate cross-modal retrieval into completion task to learn structural prior information from similar reference samples. Specifically, we design a Structural Shared Feature Encoder (SSFE) to jointly extract cross-modal features and reconstruct reference features as priors. Benefiting from a dual-channel control gate in the encoder, relevant structural features in the reference sample are enhanced and irrelevant information interference is suppressed. In addition, we propose a Progressive Retrieval-Augmented Generator (PRAG) that employs a hierarchical feature fusion mechanism to integrate reference prior information with input features from global to local. Through extensive evaluations on multiple datasets and real-world scenes, our method shows its effectiveness in generating fine-grained point clouds, as well as its generalization capability in handling sparse data and unseen categories.

点云补全跨模态检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。