arXiv:2511.10316cs.CVcs.AI2025-11被引 2

通过物理模糊建模与多视角几何约束,提升复杂场景下3D高斯点云的深度一致性。

Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision

  • 融合景深物理模型与多视角几何监督,统一近远场深度优化。
  • 在Waymo数据集上实现0.8 dB PSNR提升,显著改善远距离深度估计和近距离结构保持。
  • 适合城市环境三维重建、自动驾驶感知等需高精度深度的任务。

在存在极端深度变化的场景中,近场与远场区域的监督信号不一致,导致三维重建困难。现有方法难以同时解决远距离深度估计不准和近距离结构退化问题。本文提出一种新计算框架,结合景深监督与多视角一致性监督,改进3D高斯点云渲染。核心包括:(1) 景深监督采用尺度恢复的单目深度估计器(如Metric3D)生成深度先验,利用模糊卷积合成物理真实的模糊图像,并通过新型景深损失强制几何一致性,提升远近场深度保真度;(2) 多视角一致性监督基于LoFTR进行半密集特征匹配,通过最小二乘优化可靠匹配点以减少跨视图几何误差并强化深度一致性。联合物理成像原理与学习式深度正则化,本方法在Waymo Open Dataset上相较最先进方法实现0.8 dB PSNR提升,为城市环境中复杂深度分层提供可扩展解决方案。

原文摘要 · Abstract (English)

Three-dimensional reconstruction in scenes with extreme depth variations remains challenging due to inconsistent supervisory signals between near-field and far-field regions. Existing methods fail to simultaneously address inaccurate depth estimation in distant areas and structural degradation in close-range regions. This paper proposes a novel computational framework that integrates depth-of-field supervision and multi-view consistency supervision to advance 3D Gaussian Splatting. Our approach comprises two core components: (1) Depth-of-field Supervision employs a scale-recovered monocular depth estimator (e.g., Metric3D) to generate depth priors, leverages defocus convolution to synthesize physically accurate defocused images, and enforces geometric consistency through a novel depth-of-field loss, thereby enhancing depth fidelity in both far-field and near-field regions; (2) Multi-View Consistency Supervision employing LoFTR-based semi-dense feature matching to minimize cross-view geometric errors and enforce depth consistency via least squares optimization of reliable matched points. By unifying defocus physics with multi-view geometric constraints, our method achieves superior depth fidelity, demonstrating a 0.8 dB PSNR improvement over the state-of-the-art method on the Waymo Open Dataset. This framework bridges physical imaging principles and learning-based depth regularization, offering a scalable solution for complex depth stratification in urban environments.

3D重建高斯点云深度估计多视角几何

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。