arXiv:2504.15095cs.CV2025-04

提升远距离单目深度估计精度,解决细节丢失与数据分布偏差问题

VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting

  • 引入频域调制模块,动态增强远距离结构的高频细节重建
  • 设计自适应重加权机制,在扩散过程中平衡不同距离区域的训练信号
  • 特别适合需要精准远距离感知的应用场景,如自动驾驶

单目深度估计(MDE)旨在从单张RGB图像中推断每像素的深度。尽管扩散模型在MDE中展现出优异的泛化能力,但在远距离区域的重建精度仍受限。主要挑战有两个:其一,标准空间域模型的隐式多尺度处理难以保留远距离结构所依赖的细粒度高频细节;其二,深度数据的长尾分布导致模型训练偏向常见近距区域。为此,我们提出VistaDepth,一种面向均衡准确深度感知的新型扩散框架。引入两个核心创新:一是潜空间频域调制(LFM)模块,通过轻量网络预测内容感知的动态谱滤波器,精细化重构潜变量特征,显著提升远距离结构重建能力;二是偏差图(BiasMap)机制,基于扩散过程的时间步自适应重加权损失,使监督信号与渐进去噪过程更一致,有效缓解数据偏差且不损害训练稳定性。实验表明,VistaDepth在基于扩散的MDE任务中达到当前最优性能,尤其在远距离区域的细节还原与精度上表现突出。

原文摘要 · Abstract (English)

Monocular depth estimation (MDE) aims to infer per-pixel depth from a single RGB image. While diffusion models have advanced MDE with impressive generalization, they often exhibit limitations in accurately reconstructing far-range regions. This difficulty arises from two key challenges. First, the implicit multi-scale processing in standard spatial-domain models can be insufficient for preserving the fine-grained, high-frequency details crucial for distant structures. Second, the intrinsic long-tail distribution of depth data imposes a strong training bias towards more prevalent near-range regions. To address these, we propose VistaDepth, a novel diffusion framework designed for balanced and accurate depth perception. We introduce two key innovations. First, the Latent Frequency Modulation (LFM) module enhances the model's ability to represent high-frequency details. It operates by having a lightweight network predict a dynamic, content-aware spectral filter to refine latent features, thereby improving the reconstruction of distant structures. Second, our BiasMap mechanism introduces an adaptive reweighting of the diffusion loss strategically scaled across diffusion timesteps. It further aligns the supervision with the progressive denoising process, establishing a more consistent learning signal. As a result, it mitigates data bias without sacrificing training stability. Experiments show that VistaDepth achieves state-of-the-art performance for diffusion-based MDE, particularly excelling in reconstructing detailed and accurate depth in far-range regions.

深度估计扩散模型远距离感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。