用可靠几何信息训练无深度的图像分割模型,提升精度。
When Depth Hurts: Reliability-Aware Geometry Distillation for Depth-Free RGB-D Salient Object Detection

- 用冻结的深度模型提取几何结构,蒸馏给轻量级边缘感知分支。
- 在26组对比中表现最佳或并列最佳,ReDWeb-S上MAE降低13.4%。
- 无需真实深度数据,适合部署受限或深度不可靠的场景。
深度可缓解RGB-D显著目标检测中的外观模糊问题,但传感器深度并不总是可靠:缺失区域、模糊边界和结构伪影会通过多模态融合传播,导致RGB-D检测器性能低于仅使用RGB的方法。现有质量感知方法虽能调控观测深度,但仍依赖可能缺陷的深度模态。我们提出 extmethod,一种专为无深度训练与推理设计的可靠性感知几何蒸馏框架。训练时,一个冻结的Depth Anything V2模型作为教师,将密集相对几何、层级空间注意力和边界结构传递给紧凑的边缘感知几何分支。池化双向交互使几何与外观对齐,像素级可靠性估计器选择性注入与当前RGB表示兼容的几何信息。训练完成后移除教师,留下仅需RGB输入的推理网络。在2,985对RGB-mask数据上训练, extmethod在36组指标-数据集对比中取得26项最优或并列最优,包括ReDWeb-S上13.4%的相对MAE降低。在重新训练于DUTS-TR后,也在PASCAL-S上将最强基线的F-measure提升4.2%,表明蒸馏几何具备跨传感器与数据集的泛化能力。代码将在发表后公开。
原文摘要 · Abstract (English)
Depth can resolve appearance ambiguity in RGB-D salient object detection (SOD), yet sensor depth is not uniformly reliable. Missing regions, blurred boundaries, and structural artifacts can propagate through multimodal fusion and make an RGB-D detector less accurate than its RGB-only counterpart. Existing quality-aware approaches regulate observed depth but remain dependent on the same potentially defective modality. We propose \method, a reliability-aware geometry distillation framework developed for RGB-D SOD benchmarks without using dataset-provided depth during training or inference. A frozen Depth Anything V2 model serves only as a training-time teacher, transferring dense relative geometry, hierarchical spatial attention, and boundary structure to a compact edge-aware geometry branch. Pooled bidirectional interaction aligns geometry with appearance, and a pixel-wise reliability estimator selectively injects geometry that is compatible with the current RGB representation. The teacher is removed after training, leaving an RGB-only inference network. Trained on 2,985 RGB-mask pairs, \method{} achieves the best or tied-best result in 26 of 36 metric-dataset comparisons against ten recent RGB-D SOD methods, including a 13.4\% relative MAE reduction on ReDWeb-S. When retrained on DUTS-TR, it also improves the strongest prior $F$-measure by 4.2\% on PASCAL-S, showing that the distilled geometry transfers beyond a particular sensor or dataset domain. Code will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。