arXiv:2512.17955cs.CV2025-12

用扩散模型分步重建单张图中的室内3D场景,效果优于现有方法。

A Modular Framework for Single-View 3D Reconstruction of Indoor Environments

  • 分两步:先用扩散模型补全遮挡部分,再转为3D结构
  • 在3D-Front数据集上,视觉质量与重建精度均超越当前最优方法
  • 适合室内设计、房产展示和增强现实等应用

我们提出一种模块化框架,用于从单张图像重建室内场景的3D结构,核心模块基于扩散技术。传统方法常因室内物体形状复杂、相互遮挡而难以准确预测3D形状,往往直接从不完整2D图像推断3D,导致重建质量有限。为此,我们将其分解为两步:首先利用扩散模型恢复被遮挡物体的完整视图及房间背景,随后转换为3D。框架包含四个关键组件:用于恢复被遮挡物体完整外观的无模态补全模块、专门训练用于预测房间布局的修复模型、兼顾整体几何精度与细节表达的混合深度估计方法,以及结合2D与3D线索实现物体精准定位的视图空间对齐方法。该方法能有效从单张图像重建前景物体与房间背景。在3D-Front数据集上的大量实验表明,本方法在视觉质量和重建精度上均优于当前最先进的方法。该框架在室内设计、房地产和增强现实等领域具有广泛应用潜力。

原文摘要 · Abstract (English)

We propose a modular framework for single-view indoor scene 3D reconstruction, where several core modules are powered by diffusion techniques. Traditional approaches for this task often struggle with the complex instance shapes and occlusions inherent in indoor environments. They frequently overshoot by attempting to predict 3D shapes directly from incomplete 2D images, which results in limited reconstruction quality. We aim to overcome this limitation by splitting the process into two steps: first, we employ diffusion-based techniques to predict the complete views of the room background and occluded indoor instances, then transform them into 3D. Our modular framework makes contributions to this field through the following components: an amodal completion module for restoring the full view of occluded instances, an inpainting model specifically trained to predict room layouts, a hybrid depth estimation technique that balances overall geometric accuracy with fine detail expressiveness, and a view-space alignment method that exploits both 2D and 3D cues to ensure precise placement of instances within the scene. This approach effectively reconstructs both foreground instances and the room background from a single image. Extensive experiments on the 3D-Front dataset demonstrate that our method outperforms current state-of-the-art (SOTA) approaches in terms of both visual quality and reconstruction accuracy. The framework holds promising potential for applications in interior design, real estate, and augmented reality.

3D重建扩散模型室内场景单视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。