arXiv:2606.09495cs.CV2026-06

提出可控的上下文基准,揭示目标检测模型在场景变化下的隐藏退化问题。

ContextShift: A Controlled Benchmark for Context Dependence in Object Detection

论文配图:ContextShift: A Controlled Benchmark for Context Dependence in Object Detection
图 1 · 摘自论文原文
  • 通过几何变换与背景替换,分离上下文变量,构建可控制的测试环境。
  • 模型在复杂上下文中误检率飙升227%,预测数量减少44%,但误报稳定。
  • 发现上下文依赖非线性,中等共现性下性能最佳,适合提升模型鲁棒性的研究者。

现代目标检测器在标准基准上表现优异,但对上下文变化的鲁棒性仍不明确。以往评估多依赖平均精度(AP)等聚合指标,难以反映上下文变化下的真实性能退化。本文提出 ContextShift,一个基于 COCO 2017 的受控基准,通过几何变换与合成/自然背景替换,系统性地操控物体-上下文关系,同时保持物体外观不变,并引入基于归一化点互信息(NPMI)的连续兼容性轴。在多种检测架构下,均观察到一致退化模式:假负例最高增加227%,预测数量最多下降44%,而假正例保持稳定或下降。该抑制行为未被传统 AP 指标捕捉,掩盖了召回率显著下降和预测动态变化。进一步分析表明,退化主要源于有效检测候选生成减少,而非置信度降低。此外,沿统计兼容性轴的性能呈非单调变化,峰值出现在中等 NPMI 处,两端均下降,说明统计共现性与有效视觉上下文无线性关联。最后,证明上下文感知增强可提升鲁棒性:所有增强版本在原始与扰动图像上均优于仅用数据集训练的基线,通过训练阶段暴露物体-上下文解耦,部分恢复因预测抑制失败损失的性能。

原文摘要 · Abstract (English)

Modern object detectors achieve strong performance on standard benchmarks, yet their robustness to contextual variation remains insufficiently understood. Prior evaluations largely rely on aggregate metrics such as AP on uncontrolled distribution shifts, which can obscure how performance degrades under context change. We introduce ContextShift, a controlled benchmark that systematically manipulates object--context relationships while preserving object appearance. Built on COCO 2017, it isolates context as an independent variable through geometric transformations and synthetic and natural background substitutions, including a continuous compatibility axis based on normalized pointwise mutual information (NPMI). Across diverse detector architectures, we observe a consistent degradation pattern: false negatives increase by up to 227% and prediction volume decreases by up to 44%, while false positives remain stable or decline. This suppression behavior is not captured by aggregate metrics such as AP, which can mask substantial recall loss and changes in prediction dynamics. Further analysis suggests that degradation is driven less by reduced confidence than by a reduced formation of valid detection candidates. Moreover, performance along the statistical compatibility axis is non-monotonic, peaking at intermediate NPMI and degrading toward both extremes, indicating that statistical co-occurrence does not correlate linearly with effective visual context. Finally, we show that context-aware augmentation improves robustness: every augmented variant outperforms the dataset-only baseline on both original and manipulated test images, partially recovering performance lost to prediction-suppression failures by exposing models to object--context decoupling during training.

目标检测上下文依赖基准测试鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。