arXiv:2412.16028cs.CV2024-12CVPR被引 3

用模糊图像实现高精度3D场景重建,突破传统清晰图限制

CoCoGaussian: Leveraging Circle of Confusion for Gaussian Splatting from Defocused Images

论文配图:CoCoGaussian: Leveraging Circle of Confusion for Gaussian Splatting from Defocused Images
图 1 · 摘自论文原文
  • 基于物理光学原理建模模糊圈(CoC),结合深度与可学习光圈参数
  • 通过多高斯模拟模糊形状,在模糊图像上实现优于现有方法的重建质量
  • 适合处理反光、折射等复杂场景的3D重建,尤其适用于真实拍摄数据

3D高斯泼溅(3DGS)因其高质量的新视角渲染而受到广泛关注,推动了对真实世界挑战的研究。传统方法依赖清晰图像进行精确场景重建,但现实中由于有限景深常出现散焦模糊,因此需考虑更真实的3D场景表示。本文提出CoCoGaussian,一种基于模糊圈(Circle of Confusion, CoC)感知的高斯泼溅方法,仅使用模糊图像即可实现精准3D场景表示。CoCoGaussian通过基于摄影散焦物理原理的建模方式,利用3D高斯计算从深度和可学习光圈信息推导出的CoC直径,并生成多个高斯以精确捕捉CoC形状。此外,引入可学习缩放因子提升鲁棒性,增强对反射或折射表面中不可靠深度的处理能力。在合成与真实世界数据集上的实验表明,CoCoGaussian在多个基准测试中达到当前最优性能。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has attracted significant attention for its high-quality novel view rendering, inspiring research to address real-world challenges. While conventional methods depend on sharp images for accurate scene reconstruction, real-world scenarios are often affected by defocus blur due to finite depth of field, making it essential to account for realistic 3D scene representation. In this study, we propose CoCoGaussian, a Circle of Confusion-aware Gaussian Splatting that enables precise 3D scene representation using only defocused images. CoCoGaussian addresses the challenge of defocus blur by modeling the Circle of Confusion (CoC) through a physically grounded approach based on the principles of photographic defocus. Exploiting 3D Gaussians, we compute the CoC diameter from depth and learnable aperture information, generating multiple Gaussians to precisely capture the CoC shape. Furthermore, we introduce a learnable scaling factor to enhance robustness and provide more flexibility in handling unreliable depth in scenes with reflective or refractive surfaces. Experiments on both synthetic and real-world datasets demonstrate that CoCoGaussian achieves state-of-the-art performance across multiple benchmarks.

3D重建模糊处理高斯泼溅物理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。