arXiv:2605.05664cs.CV2026-05International Conf…

仅用6-8张图就能重建完整高保真3D场景。

Sparse-to-Complete: From Sparse Image Captures to Complete 3D Scenes

论文配图:Sparse-to-Complete: From Sparse Image Captures to Complete 3D Scenes
图 1 · 摘自论文原文
  • 用微调扩散模型修复稀疏图像,提升渲染质量。
  • 通过相机轨迹规划确保场景全覆盖,避免遗漏区域。
  • 无需额外训练即可生成视角一致的图像,适合低资源重建。

我们提出S2C-3D,一种新颖的稀疏视图3D重建框架,仅需6至8张图像即可实现高质量、完整的场景重建。该框架包含三个组件:针对场景特性的扩散模型用于图像修复;无需训练的视图一致性条件采样过程,优化高斯点云;以及相机轨迹规划方案,保证全面覆盖。扩散模型通过在输入图像及其退化版本上微调预训练架构,适应场景分布,有效修复高斯渲染并消除领域差异。轨迹规划通过连接新采样相机与其最近两个邻居,迭代构建路径并保留显著提升可视性的路径,实现全场景覆盖。为解决多视角冲突,视图一致性条件采样量化邻近修复图像的一致性,并将其作为条件注入冻结扩散模型的采样过程,从而生成视角一致图像而无需额外训练。实验表明,S2C-3D优于现有方法,在极稀疏输入下生成无缺失、模糊或伪影的高质量3D高斯场景。代码与数据见https://gapszju.github.io/S2C-3D。

原文摘要 · Abstract (English)

We introduce S2C-3D, a novel sparse-view 3D reconstruction framework for high-fidelity and complete scene reconstruction from as few as six to eight images. Our framework features three components: a specialized diffusion model for scene-specific image restoration, a training-free view-consistency conditioned sampling process in the diffusion model for refined Gaussian optimization, and a camera trajectory planning scheme to ensure comprehensive scene coverage. The specialized diffusion model is developed by finetuning a pretrained architecture on the input views and their corresponding degraded counterparts. The adaptation to the scene distribution allows the model to repair Gaussian renderings while effectively eliminating domain gaps. Meanwhile, the trajectory planning scheme optimizes scene coverage by connecting each newly sampled camera to its two nearest neighbors. By iteratively constructing paths and retaining only those that significantly enhance visibility, the scheme establishes a trajectory that covers the entire scene. To address multi-view conflicts, the view-consistency conditioned sampling process quantifies the consistency between neighboring repaired images. This information is injected as a condition into the sampling process of the frozen diffusion model, facilitating the generation of view-consistent images without additional training. Consequently, our approach produces high-fidelity 3D Gaussians that are robust to artifacts. Experimental results demonstrate that S2C-3D outperforms state-of-the-art methods, constructing high-quality scenes that are free from missing regions, blurring, or other artifacts with very sparse inputs. The source code and data are available at https://gapszju.github.io/S2C-3D.

3D重建扩散模型稀疏视图高斯渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。