arXiv:2411.19036cs.CVcs.GR2024-11CVPR被引 21

用多视角扩散先验补全点云,细节更逼真。

PCDreamer: Point Cloud Completion Through Multi-view Diffusion Priors

  • 通过大模型生成多视角图像获取形状先验
  • 在复杂形状补全中恢复出精细细节
  • 适合需要高精度3D重建的研究者

本文提出PCDreamer,一种新型点云补全方法。传统方法从部分点云提取特征预测缺失区域,但解空间过大导致效果不佳;近期方法引入图像作为辅助引导,虽提升性能,但图像与点云配对数据难以获取。为克服此问题,我们利用大模型中相对一致的多视角扩散先验,生成目标形状的新视角图像。这些图像同时包含全局与局部形状线索,显著有助于补全。为此,设计了形状融合模块,结合图像与点云输入生成初始完整形状;并引入形状强化模块,通过剔除扩散先验不一致性带来的不可靠点,获得最终完整形状。大量实验表明,该方法在恢复精细结构方面表现优异。

原文摘要 · Abstract (English)

This paper presents PCDreamer, a novel method for point cloud completion. Traditional methods typically extract features from partial point clouds to predict missing regions, but the large solution space often leads to unsatisfactory results. More recent approaches have started to use images as extra guidance, effectively improving performance, but obtaining paired data of images and partial point clouds is challenging in practice. To overcome these limitations, we harness the relatively view-consistent multi-view diffusion priors within large models, to generate novel views of the desired shape. The resulting image set encodes both global and local shape cues, which are especially beneficial for shape completion. To fully exploit the priors, we have designed a shape fusion module for producing an initial complete shape from multi-modality input (i.e.,, images and point clouds), and a follow-up shape consolidation module to obtain the final complete shape by discarding unreliable points introduced by the inconsistency from diffusion priors. Extensive experimental results demonstrate our superior performance, especially in recovering fine details.

点云补全扩散模型多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。