arXiv:2604.04406cs.CV2026-04被引 4

从单张图修复3D场景,先粗后细逐步补全缺失部分。

3D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Image

论文配图:3D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Image
图 1 · 摘自论文原文
  • 用碎片化几何作锚点,原位生成完整3D物体。
  • 在110K场景数据上训练,几何精度显著领先基线。
  • 适合需要高效高精度3D重建的研究与应用。

从单视角图像生成组合式3D场景需同时恢复场景布局与3D资产。现有方法分为前馈生成与实例级生成两类:前者效率高但泛化差,后者泛化好但优化耗时。为此,我们提出3D-Fixer,一种新型原位补全范式。该方法将3D生成先验扩展至基于原始位置部分可见点云的完整资产生成,点云来自几何估计方法得到的碎片化几何。不同于需显式对齐姿态的旧方法,3D-Fixer以碎片化几何为空间锚点,保持布局保真度。核心提出粗到细生成策略,解决遮挡下的边界模糊问题,辅以双分支条件网络与抗遮挡特征对齐(ORFA)策略实现稳定训练。为缓解数据稀缺瓶颈,我们构建了目前最大规模的场景级数据集ARSG-110K,包含超11万多样场景及300万带高保真3D标注图像。大量实验表明,3D-Fixer在几何精度上达到当前最优,显著优于MIDI和Gen3DSR等基线,同时保持扩散过程的高效性。代码与数据将公开于https://zx-yin.github.io/3dfixer。

原文摘要 · Abstract (English)

Compositional 3D scene generation from a single view requires the simultaneous recovery of scene layout and 3D assets. Existing approaches mainly fall into two categories: feed-forward generation methods and per-instance generation methods. The former directly predict 3D assets with explicit 6DoF poses through efficient network inference, but they generalize poorly to complex scenes. The latter improve generalization through a divide-and-conquer strategy, but suffer from time-consuming pose optimization. To bridge this gap, we introduce 3D-Fixer, a novel in-place completion paradigm. Specifically, 3D-Fixer extends 3D object generative priors to generate complete 3D assets conditioned on the partially visible point cloud at the original locations, which are cropped from the fragmented geometry obtained from the geometry estimation methods. Unlike prior works that require explicit pose alignment, 3D-Fixer uses fragmented geometry as a spatial anchor to preserve layout fidelity. At its core, we propose a coarse-to-fine generation scheme to resolve boundary ambiguity under occlusion, supported by a dual-branch conditioning network and an Occlusion-Robust Feature Alignment (ORFA) strategy for stable training. Furthermore, to address the data scarcity bottleneck, we present ARSG-110K, the largest scene-level dataset to date, comprising over 110K diverse scenes and 3M annotated images with high-fidelity 3D ground truth. Extensive experiments show that 3D-Fixer achieves state-of-the-art geometric accuracy, which significantly outperforms baselines such as MIDI and Gen3DSR, while maintaining the efficiency of the diffusion process. Code and data will be publicly available at https://zx-yin.github.io/3dfixer.

3D重建单图生成扩散模型场景补全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。