用深度信息做先验,提升小远物体检测效果
Depth as Prior Knowledge for Object Detection
- 将深度作为先验而非融合特征,避免修改模型结构
- 小物体检测mAP最高提升9%,误检率降低至1:95
- 无需额外传感器或计算开销,适合安全关键场景
小而远的物体检测因尺度变化、低分辨率和背景干扰仍具挑战性,安全应用需可靠检测以支持决策。现有方法依赖复杂的架构改造来利用深度信息。本文通过理论分析与实证研究揭示了深度导致性能下降的机制,并提出DepthPrior框架:训练阶段采用基于深度的损失加权(DLW)和分层(DLS),推理时使用深度感知置信度阈值(DCT)。仅需初始深度估计成本,不改变检测器结构。在KITTI、MS COCO、VisDrone、SUN RGB-D四个基准上,对YOLOv11和EfficientDet两种检测器验证,小物体检测的mAP$_S$最高提升9%,mAR$_S$提升7%,误检与真检比达95:1。该方法无需额外传感器、不增加计算负担,代码已开源。
原文摘要 · Abstract (English)
Detecting small and distant objects remains challenging for object detectors due to scale variation, low resolution, and background clutter. Safety-critical applications require reliable detection of these objects for safe planning. Depth information can improve detection, but existing approaches require complex, model-specific architectural modifications. We provide a theoretical analysis followed by an empirical investigation of the depth-detection relationship. Together, they explain how depth causes systematic performance degradation and why depth-informed supervision mitigates it. We introduce DepthPrior, a framework that uses depth as prior knowledge rather than as a fused feature, providing comparable benefits without modifying detector architectures. DepthPrior consists of Depth-Based Loss Weighting (DLW) and Depth-Based Loss Stratification (DLS) during training, and Depth-Aware Confidence Thresholding (DCT) during inference. The only overhead is the initial cost of depth estimation. Experiments across four benchmarks (KITTI, MS COCO, VisDrone, SUN RGB-D) and two detectors (YOLOv11, EfficientDet) demonstrate the effectiveness of DepthPrior, achieving up to +9% mAP$_S$ and +7% mAR$_S$ for small objects, with inference recovery rates as high as 95:1 (true vs. false detections). DepthPrior offers these benefits without additional sensors, architectural changes, or performance costs. Code is available at https://github.com/mos-ks/DepthPrior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。