arXiv:2601.21291cs.CV2026-01中稿 · ECCV被引 1

用概率图模型融合深度学习,提升稀疏深度图补全效果

Gaussian Belief Propagation Network for Depth Completion

  • 构建动态马尔可夫随机场,自适应生成长程依赖关系
  • 在NYUv2和KITTI上达到最新最优,高稀疏度下仍稳定表现
  • 适合需要鲁棒深度补全的自动驾驶与三维重建场景

深度补全旨在从带有稀疏深度测量的彩色图像中预测稠密深度图。尽管深度学习方法已达到最先进水平,但如何在深度网络中有效处理输入深度数据的稀疏性和不规则性仍是重大挑战,尤其在高稀疏度下性能受限。为此,我们提出高斯信念传播网络(GBPN),一种融合深度学习与概率图模型的端到端框架。具体地,图模型构建网络(GMCN)动态构建场景相关的马尔可夫随机场(MRF),并通过高斯信念传播(GBP)推断出稠密深度分布。关键在于,GMCN不仅学习MRF的数据相关势能,还通过预测自适应非局部边来构建其结构,从而捕捉复杂的长程空间依赖。此外,我们设计了串行与并行结合的消息传递机制,以增强信息传播,特别是从稀疏测量点出发的传播效率。大量实验表明,GBPN在NYUv2和KITTI基准上均达到最先进性能。在不同稀疏度、稀疏模式及数据集上的评估验证了其优越性、显著鲁棒性与良好泛化能力。

原文摘要 · Abstract (English)

Depth completion aims to predict a dense depth map from a color image with sparse depth measurements. Although deep learning methods have achieved state-of-the-art (SOTA), effectively handling the sparse and irregular nature of input depth data in deep networks remains a significant challenge, often limiting performance, especially under high sparsity. To overcome this limitation, we introduce the Gaussian Belief Propagation Network (GBPN), a novel hybrid framework synergistically integrating deep learning with probabilistic graphical models for end-to-end depth completion. Specifically, a scene-specific Markov Random Field (MRF) is dynamically constructed by the Graphical Model Construction Network (GMCN), and then inferred via Gaussian Belief Propagation (GBP) to yield the dense depth distribution. Crucially, the GMCN learns to construct not only the data-dependent potentials of MRF but also its structure by predicting adaptive non-local edges, enabling the capture of complex, long-range spatial dependencies. Furthermore, we enhance GBP with a serial \& parallel message passing scheme, designed for effective information propagation, particularly from sparse measurements. Extensive experiments demonstrate that GBPN achieves SOTA performance on the NYUv2 and KITTI benchmarks. Evaluations across varying sparsity levels, sparsity patterns, and datasets highlight GBPN's superior performance, notable robustness, and generalizable capability.

深度补全概率图模型稀疏数据三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。