解决深度模型校准中异常锚点导致的失效问题,无需重训练即可稳定提升精度。
The Multipath Blind Spot: $K$-Agnostic Robust Calibration for Sparse-Anchor Metric Depth from Frozen Foundations

- 用基础模型自身相对深度顺序做一致性检验,筛选可靠锚点
- 在四类异常数据上,KITTI误差降低3.2倍(0.489→0.151)
- 零参数、仅50微秒推理时间,适配任意锚点数量,部署友好
单目深度预训练模型能预测通用相对深度,但缺乏绝对尺度;少量来自测距传感器的稀疏度量锚点可将其校准为度量深度,是替代度量监督训练的可行方案。然而现有方法假设锚点干净,而真实传感器常产生异常值——如飞行时间多路径干扰、混合像素等——并非简单缺失。我们发现现有残差-对齐校准方法在异常锚点下失效,最强公开方法VI-Depth存在结构化多路径盲区:虽对缺失锚点鲁棒,但在三组数据集上,当锚点存在但错误时反而劣于无保护基线。本文提出多路径鲁棒锚点校准(MRAC),一种无参、推理时封装的锚点筛选框架,通过泰尔-森拟合与中位数绝对偏差测试,基于基础模型自身的相对深度排序筛选锚点,再调用一次校准头。MRAC不引入学习参数,在CPU上耗时约50μs,支持锚点数K∈[5,200]的一次检查点部署。在320单元基准测试中,相同骨干、架构控制下,MRAC在所有四类异常场景中严格胜出84%的同骨架单元;相较VI-Depth,在全部12个受污染多路径单元和16个KITTI单元上均表现更优,将KITTI多路径下AbsRel误差降低3.2倍(从0.489降至0.151),且无需任何重训练。
原文摘要 · Abstract (English)
Monocular depth foundations predict domain-general relative depth but lack absolute scale; a handful of sparse metric anchors from a range sensor can calibrate them to metric depth, an attractive alternative to metric-supervised training. Existing sparse-anchor calibration methods, however, assume the anchors are clean, whereas real sensors produce outliers that are present with the wrong value -- time-of-flight multipath, mixed pixels -- not merely missing. We show that the established residual-on-CFA calibration recipe collapses under such outliers, and that the strongest publicly deployed method, VI-Depth, has a structural multipath blind spot: robust to missing anchors, it falls behind an unprotected baseline on three of four datasets when anchors are present but wrong. We propose Multipath-Robust Anchor Calibration (MRAC), a parameter-free, inference-time wrapper that gates anchors by foundation consistency -- a Theil--Sen fit and a median-absolute-deviation test against the foundation's own relative-depth ordering -- before a single call to the calibration head. MRAC adds no learned parameters, runs its selection in $\approx 50\,μ$s on CPU, and serves anchor budgets $K \in [5,200]$ from one checkpoint. On a $320$-cell benchmark with a same-backbone, same-architecture control, MRAC strictly wins $84\%$ of same-backbone cells across all four outlier families and, against VI-Depth, wins all twelve corrupted multipath cells and all sixteen KITTI cells, reducing KITTI multipath AbsRel by $3.2\times$ ($0.489$ to $0.151$) at zero retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。