arXiv:2607.02568cs.CV2026-07

用图像引导点云补全,提升几何一致性与细节还原能力。

MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement

论文配图:MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement
图 1 · 摘自论文原文
  • 引入共享自注意力与跨模态监督,增强图像与点云特征对齐。
  • 设计自适应几何注意力模块,同时捕捉全局形状与局部细节。
  • 适用于需要高精度3D补全的工业重建与自动驾驶场景。

基于视图的点云补全旨在从部分点云和单张图像中恢复完整3D形状。现有方法常因模态对齐弱和自几何增强有限而性能受限。为此,本文提出统一的几何感知框架,集成高效模态对齐与自适应几何增强,以解决视图引导点云补全中的跨模态几何不一致问题。具体地,提出一种基于共享自注意力变换器与跨模态重建监督的几何感知模态对齐机制,使图像与点云特征在描述3D物体的共享隐空间中更接近。为增强对全局形状和局部几何细节的感知,设计自适应几何感知自注意力模块,同时考虑局部几何感知注意力计算与空间可变特征融合。此外,引入几何感知锚点精炼模块,在适当监督下重组织代表形状局部区域的锚点,进一步提升补全性能。在合成与真实世界数据集上的大量实验表明,该方法显著优于现有方法。代码将开源于 https://github.com/weizequan/MAGE。

原文摘要 · Abstract (English)

View-based point cloud completion aims to recover a complete 3D shape from a partial point cloud, guided by a single-view image. However, existing approaches often suffer from limited performance due to weak modality alignment and limited self-geometry enhancement. To overcome these challenges, we propose a unified geometry-aware framework that integrates efficient modality alignment and adaptive geometry enhancement, mainly to address cross-modal geometric inconsistency of view-guided point cloud completion. Specifically, we propose a geometry-aware modality alignment by integrating a shared self-attention Transformer and cross-modality reconstruction supervision, which aims to bring features of the image and point cloud close to each other in a shared latent space describing the 3D object. To enhance the perception of global shape and local geometric details, we propose an adaptive geometry-aware self-attention module, which simultaneously considers local geometry-aware attention computation and the spatially-variant feature fusion. In addition, we apply a geometry-perceptive anchor refinement module to reorganize the anchor points (representing a local region of the shape) under appropriate supervision, further boosting the completion performance of our method. Extensive experiments on both synthetic and real-world datasets demonstrate that our method achieves superior performance over existing approaches. Our code will be available at https://github.com/weizequan/MAGE.

点云补全多模态几何增强图像引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。