arXiv:2508.18271cs.CV2025-08

通过密集多视角联合优化,实现高质量、一致的3D物体修复。

ObjFiller3D: Scaling 3D Object Inpainting to Dense Multi-View Consistency

  • 采用360°轨迹密集采样视角,全局协同优化提升一致性
  • 在多个数据集上实现PSNR 26.6、LPIPS 0.19的高保真度与感知质量
  • 支持参考图像引导,修复时间从40分钟缩短至10分钟内

3D物体修复通常依赖多视角2D图像补全,但独立修复各视角易导致跨视角不一致,引发纹理模糊、几何断层和视觉伪影。为此,我们提出ObjFiller-3D,一种用于高质量、一致3D物体重建与编辑的新方法。该方法不依赖稀疏视图编辑或单视图2D补全,而是沿360°轨迹联合优化一系列密集采样视角,实现视角间全局一致性。框架包含三个互补组件:时序驱动生成编码器用于建模密集视角依赖,语义感知补全编码器实现物体级修复,循环一致3D编码器通过闭环结构强化全局一致性。同时支持参考图像引导的3D补全,实现外观精细控制。在多个数据集上的实验表明,该方法显著优于现有方法,在重建保真度(PSNR 26.6 vs. 15.9)和感知质量(LPIPS 0.19 vs. 0.25)方面均有大幅提升,且重建时间从超40分钟降至10分钟以内。结果验证了其在真实3D编辑场景中的有效性与实用性。

原文摘要 · Abstract (English)

3D object inpainting is commonly achieved via multi-view 2D image completion, yet independently inpainted views often suffer from cross-view inconsistencies, leading to blurred textures, geometric discontinuities, and visual artifacts in the reconstructed 3D objects. To overcome these limitations, we propose ObjFiller-3D, a novel method designed for the completion and editing of high-quality and consistent 3D objects. Instead of relying on sparse-view editing or per-view 2D inpainting, our method jointly optimizes a sequence of densely sampled views along a $360^\circ$ trajectory, enabling global coherence across viewpoints. We design a new framework with three complementary components: a Temporal-Driven Generative Encoder for modeling dense-view dependencies, a Semantic-Aware Completion Encoder for object-level inpainting, and a Cycle-Consistent 3D Encoder that enforces global coherence through a closed-loop formulation. Our framework also supports reference-guided 3D inpainting, allowing fine-grained control over appearance. Extensive experiments on diverse datasets demonstrate that ObjFiller-3D significantly outperforms prior methods, achieving higher reconstruction fidelity (PSNR 26.6 vs.\ 15.9 of NeRFiller) and perceptual quality (LPIPS 0.19 vs.\ 0.25 of Instant3dit), while reducing reconstruction time from over 40 minutes to under 10 minutes. These results highlight the effectiveness and practical potential of our approach for real-world 3D editing applications. Project page: https://objfiller3d.github.io/ Code: https://github.com/objfiller3d/ObjFiller-3D .

3D修复多视角一致生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。