arXiv:2604.03339cs.CV2026-04

用轻量级模块提升单目深度估计精度,兼顾速度与细节。

Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction

  • 分层感知适配器+混合金字塔融合,捕捉远近上下文
  • 在NYU数据集上绝对误差降7.4%,推理仅需21毫秒
  • 适合追求高精度与低延迟的工业级视觉系统

单目深度估计因固有的尺度模糊性和缺乏显式几何线索而仍是计算机视觉中的基础挑战。现有方法通常依赖日益复杂的网络结构回归深度图,导致训练成本和计算开销上升,且未能充分挖掘像素间空间依赖关系。本文提出基于Swin Transformer骨干网络的多层级感知条件随机场(CRF)模型,通过三项协同创新解决上述问题:(1) 自适应混合金字塔特征融合(HPF)策略,结合多尺度空间金字塔池化与双向特征聚合,同时捕获短程与长程依赖,实现全局与局部上下文信息的有效整合;(2) 分层感知适配器(HA),通过轻量级广播模块与可学习维度缩放机制,在编码器内增强跨层级特征交互,降低计算复杂度的同时提升表征能力;(3) 全连接CRF解码器搭配动态缩放注意力机制,建模细粒度像素级空间关系,并引入偏置学习单元防止极端值坍塌,保障训练稳定性。在NYU Depth v2、KITTI和MatterPort3D数据集上的大量实验表明,该方法达到当前最优性能:在NYU Depth v2上,绝对相对误差(Abs Rel)降至0.088(下降7.4%),均方根误差(RMSE)降至0.316(下降5.4%);在KITTI上阈值精度(δ<1.25³)达99.8%,仅需194M参数与21ms推理时间。

原文摘要 · Abstract (English)

Monocular depth estimation from a single RGB image remains a fundamental challenge in computer vision due to inherent scale ambiguity and the absence of explicit geometric cues. Existing approaches typically rely on increasingly complex network architectures to regress depth maps, which escalates training costs and computational overhead without fully exploiting inter-pixel spatial dependencies. We propose a multilevel perceptual conditional random field (CRF) model built upon the Swin Transformer backbone that addresses these limitations through three synergistic innovations: (1) an adaptive hybrid pyramid feature fusion (HPF) strategy that captures both short-range and long-range dependencies by combining multi-scale spatial pyramid pooling with biaxial feature aggregation, enabling effective integration of global and local contextual information; (2) a hierarchical awareness adapter (HA) that enriches cross-level feature interactions within the encoder through lightweight broadcast modules with learnable dimensional scaling, reducing computational complexity while enhancing representational capacity; and (3) a fully-connected CRF decoder with dynamic scaling attention that models fine-grained pixel-level spatial relationships, incorporating a bias learning unit to prevent extreme-value collapse and ensure stable training. Extensive experiments on NYU Depth v2, KITTI, and MatterPort3D datasets demonstrate that our method achieves state-of-the-art performance, reducing Abs Rel to 0.088 ($-$7.4\%) and RMSE to 0.316 ($-$5.4\%) on NYU Depth v2, while attaining near-perfect threshold accuracy ($δ< 1.25^3 \approx 99.8\%$) on KITTI with only 194M parameters and 21ms inference time.

深度估计视觉任务Transformer轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。