arXiv:2607.17099cs.CVcs.AI2026-07中稿 · ACM Multimedia 202…被引 1

让小模型也能精准估深度,兼顾跨场景泛化与设备部署

DepthART: Scaling Foundation Monocular Depth to Tiny Models

论文配图:DepthART: Scaling Foundation Monocular Depth to Tiny Models
图 1 · 摘自论文原文
  • 用抗分布偏见采样+相机条件微调,提升小模型泛化能力
  • 零样本下在NYUD v2上达到δ₁=0.964,逼近大模型性能
  • 模型轻量可部署,手机级设备也能跑超15FPS

近期几何基础模型(如Metric3D、Depth Anything和UniDepth)显著提升了单目深度估计在跨场景泛化与度量尺度预测上的表现,但这些进展尚未惠及小型模型。本文提出DepthART(Depth Anything Rethought for Tiny Models),一种适用于多种场景的紧凑型单目深度估计模型,专为设备端部署设计。我们识别出小型模型的两大瓶颈:(i) 在相同训练预算下对数据集特定分布偏见的过拟合;(ii) 相机参数变化下的不稳定的度量适应性,全微调易破坏可迁移几何结构。为此,DepthART结合两种简单但有效的策略:抗偏见的数据采样方法降低分布偏差,以及相机条件微调协议——冻结蒸馏编码器,仅根据内参调整度量尺度,更好保留跨数据集泛化能力。在多个数据集上,DepthART持续优于此前的小型基线,在零样本泛化与度量精度上均表现突出(例如,DepthART-S在NYUD v2上零样本δ₁=0.964),部分情况下接近大型模型性能。我们进一步构建了可扩展的模型家族,其中DepthART-S在RTX A6000上分别实现347/245 FPS(严格FP32)@224²/448²,Orin NX 8GB上达102 FPS(TF32),Jetson Nano 4GB上超过15 FPS(FP32)。

原文摘要 · Abstract (English)

Recent geometric foundation models (e.g., Metric3D, Depth Anything and UniDepth) have substantially improved monocular depth estimation (MDE) in both cross-scene generalization and metric-scale prediction, yet these gains have not translated to tiny models. We bridge this gap with DepthART (Depth Anything Rethought for Tiny Models), which is a compact MDE model for on-device deployment across diverse scenes. We first identify two capacity-driven bottlenecks in tiny models: (i) overfitting to dataset-specific distribution bias and (ii) unstable metric adaptation under camera shift, where full fine-tuning easily damages transferable geometry. Accordingly, DepthART combines two simple but effective strategies: a bias-resistant data sampling scheme to reduce distribution bias under the same training budget, and a camera-conditioned fine-tuning protocol that freezes the distilled encoder and adjusts metric scale conditioned on intrinsics while better preserving cross-dataset generalization. Across datasets, DepthART consistently surpasses previous tiny baselines in both zero-shot generalization and metric accuracy (e.g., zero-shot $δ_1$=0.964 for DepthART-S on NYUD v2), and in some cases approaches heavy models. We further provide a scalable model family, with DepthART-S reaching 347/245 FPS (strict FP32) on an RTX A6000 at $224^2/448^2$, 102 FPS (TF32) on a Orin NX 8GB, and over 15 FPS (FP32) on a Jetson Nano 4GB.

深度估计轻量化设备部署小模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。