arXiv:2512.10369cs.CV2025-12被引 4

用双先验模型从稀疏模糊图像重建高质量3D场景

Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views

  • 结合去模糊网络与扩散模型,提供视觉与几何双重先验
  • 仅需3-9张输入图即实现高保真重建,优于现有方法
  • 适合真实场景中数据稀疏且模糊的3D重建任务

3D高斯泼溅(3DGS)是当前最先进的新视角合成方法,但其性能严重依赖密集高质量输入图像,而现实应用中常面临数据稀疏和运动模糊问题。两者形成恶性循环:稀疏视图无法利用多视角约束消除运动模糊,而模糊又抹去了对齐有限视图所需的高频细节,导致重建失败,出现碎片化和低频偏差。为此,我们提出CoherentGS,一种从稀疏模糊图像进行高保真3D重建的新框架。核心思路是采用双先验策略:结合专用去模糊网络恢复清晰细节并提供光度指导,以及利用扩散模型提供几何先验以填补未观测区域。该策略通过一致性引导的相机探索模块和深度正则化损失加以支持,确保生成过程稳定与几何合理。我们在合成与真实场景上进行定量与定性评估,使用最少3、6、9张输入视图,结果表明CoherentGS显著优于现有方法,为该挑战性任务树立了新基准。代码与视频演示见https://potatobigroom.github.io/CoherentGS/

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has emerged as a state-of-the-art method for novel view synthesis. However, its performance heavily relies on dense, high-quality input imagery, an assumption that is often violated in real-world applications, where data is typically sparse and motion-blurred. These two issues create a vicious cycle: sparse views ignore the multi-view constraints necessary to resolve motion blur, while motion blur erases high-frequency details crucial for aligning the limited views. Thus, reconstruction often fails catastrophically, with fragmented views and a low-frequency bias. To break this cycle, we introduce CoherentGS, a novel framework for high-fidelity 3D reconstruction from sparse and blurry images. Our key insight is to address these compound degradations using a dual-prior strategy. Specifically, we combine two pre-trained generative models: a specialized deblurring network for restoring sharp details and providing photometric guidance, and a diffusion model that offers geometric priors to fill in unobserved regions of the scene. This dual-prior strategy is supported by several key techniques, including a consistency-guided camera exploration module that adaptively guides the generative process, and a depth regularization loss that ensures geometric plausibility. We evaluate CoherentGS through both quantitative and qualitative experiments on synthetic and real-world scenes, using as few as 3, 6, and 9 input views. Our results demonstrate that CoherentGS significantly outperforms existing methods, setting a new state-of-the-art for this challenging task. The code and video demos are available at https://potatobigroom.github.io/CoherentGS/.

3D重建去模糊扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。