通过聚焦深层特征提升单目深度估计精度
Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation

- 以最后一层为几何锚点,按相似性筛选互补中间层
- 在MiDaS、NYUv2等数据集上显著提升深度预测准确率
- 适合研究视觉基础模型与3D感知的开发者
单目深度估计(MDE)是基础但本质病态的任务。近期基于DINO的视觉基础模型(VFMs)在密集预测任务中显著提升了精度与泛化能力。以往工作普遍采用固定间隔采样中间层构建多尺度特征,隐含假设几何信息在各层均匀分布,可能低估了模型中蕴含的结构化3D线索。本研究对DINOv3进行系统层分析,发现3D信息分布不均:深层具有更强深度可预测性,并更好捕捉样本间几何差异。受此启发,我们提出末层中心特征重组(LFR)模块,将最后一层作为几何锚点,依据最小相似性准则自适应选择互补中间层,再通过紧凑线性适配器融合至末层表示。大量实验表明,该模块持续提升MDE精度,达到当前最优水平。本研究揭示了几何知识在VFMs中的组织方式,为解锁其在密集3D任务中的潜力提供了高效策略。
原文摘要 · Abstract (English)
Monocular depth estimation (MDE) is a fundamental yet inherently ill-posed task. Recent vision foundation models (VFMs), particularly DINO-based transformers, have significantly improved accuracy and generalization for dense prediction. Prior works generally follow a unified paradigm: sampling a fixed set of intermediate transformer layers at uniform intervals to build multi-scale features. This common practice implicitly assumes that geometric information is uniformly distributed across layers, which may underutilize the structural 3D cues encoded in VFMs. In this study, we present a systematic layer-wise analysis of DINOv3, revealing that 3D information is distributed non-uniformly: deeper layers exhibit stronger depth predictability and better capture inter-sample geometric variation. Motivated by this, we introduce a Last-Layer-Centric Feature Recombination (LFR) module to enhance geometric expressiveness. LFR treats the final layer as a geometric anchor and adaptively selects complementary intermediate layers according to a minimal-similarity criterion. Selected features are fused with the last-layer representation via compact linear adapters.Extensive experiments show that LFR module consistently improves MDE accuracy and achieves state-of-the-art performance. Our analysis sheds light on how geometric knowledge is organized within VFMs and offers an efficient strategy for unlocking their potential in dense 3D tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。