arXiv:2506.15821cs.GRcs.AI2025-06被引 1

无需3D重建即可实现高质量物体移除与视图一致性。

VEIGAR: View-consistent Explicit Inpainting and Geometry Alignment for 3D object Removal

  • 直接在像素空间对齐先验,避免复杂3D重建
  • 引入无尺度深度损失,提升几何一致性
  • 训练速度是最快现有方法的3倍,效果更优

近期新视角合成与3D生成技术进步推动了图像编辑发展,重点在于保持多视角一致性。现有方法多采用双策略:跨视图一致的2D补绘(基于显式或隐式先验),以及额外一致性引导的3D重建。但传统方法通常需先进行3D重建以建立几何结构,计算开销大且重建质量常不理想。本文提出VEIGAR,一种无需初始重建的轻量级框架。它利用轻量基础模型,在像素空间显式对齐先验;并引入基于尺度不变深度损失的新监督机制,无需传统单目深度的缩放平移操作。大量实验证明,VEIGAR在重建质量和跨视图一致性上达到新基准,训练时间仅为最快现有方法的1/3,展现出效率与效果的卓越平衡。

原文摘要 · Abstract (English)

Recent advances in Novel View Synthesis (NVS) and 3D generation have significantly improved editing tasks, with a primary emphasis on maintaining cross-view consistency throughout the generative process. Contemporary methods typically address this challenge using a dual-strategy framework: performing consistent 2D inpainting across all views guided by embedded priors either explicitly in pixel space or implicitly in latent space; and conducting 3D reconstruction with additional consistency guidance. Previous strategies, in particular, often require an initial 3D reconstruction phase to establish geometric structure, introducing considerable computational overhead. Even with the added cost, the resulting reconstruction quality often remains suboptimal. In this paper, we present VEIGAR, a computationally efficient framework that outperforms existing methods without relying on an initial reconstruction phase. VEIGAR leverages a lightweight foundation model to reliably align priors explicitly in the pixel space. In addition, we introduce a novel supervision strategy based on scale-invariant depth loss, which removes the need for traditional scale-and-shift operations in monocular depth regularization. Through extensive experimentation, VEIGAR establishes a new state-of-the-art benchmark in reconstruction quality and cross-view consistency, while achieving a threefold reduction in training time compared to the fastest existing method, highlighting its superior balance of efficiency and effectiveness.

3D生成图像修复视图一致性轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。