arXiv:2602.18394cs.CV2026-02

让目标检测器能自知图像质量是否下降,避免在模糊或噪声下误判。

Self-Aware Object Detection via Degradation Manifolds

  • 通过降质流形建模图像退化特征,不依赖标签就能区分不同退化类型与程度。
  • 在合成干扰和真实天气变化数据上,纯净与退化图像的分离度超90%。
  • 适用于多种检测模型,适合自动驾驶等安全关键场景

目标检测器在正常成像条件下表现优异,但在模糊、噪声、压缩、恶劣天气或分辨率变化下可能无声失效。在安全关键场景中,仅输出预测是不够的,必须评估输入是否仍在检测器的正常工作范围内。我们称之为自知式目标检测。本文提出基于降质流形的自知框架,将检测器的特征空间按图像退化而非语义内容进行结构化。方法在标准检测骨干网络上添加轻量级嵌入头,通过多层对比学习训练:相同退化组合的图像被拉近,不同退化配置则被推远,形成几何有序的表示,无需退化标签或显式密度建模即可捕捉退化类型与严重程度。为锚定学习到的几何结构,从干净训练样本中估计一个原始原型,定义表示空间中的正常工作点。自知能力表现为对这一参考点的几何偏离,提供独立于检测置信度的图像级退化信号。在合成退化基准、跨数据集零样本迁移及自然天气引起的分布偏移上进行大量实验,结果表明纯净与退化图像具有强可分性(分离度>90%),在多个检测架构下行为一致,且在语义漂移下仍具鲁棒性。这些结果表明,降质感知的表示几何提供了实用且检测器无关的基础。

原文摘要 · Abstract (English)

Object detectors achieve strong performance under nominal imaging conditions but can fail silently when exposed to blur, noise, compression, adverse weather, or resolution changes. In safety-critical settings, it is therefore insufficient to produce predictions without assessing whether the input remains within the detector's nominal operating regime. We refer to this capability as self-aware object detection. We introduce a degradation-aware self-awareness framework based on degradation manifolds, which explicitly structure a detector's feature space according to image degradation rather than semantic content. Our method augments a standard detection backbone with a lightweight embedding head trained via multi-layer contrastive learning. Images sharing the same degradation composition are pulled together, while differing degradation configurations are pushed apart, yielding a geometrically organized representation that captures degradation type and severity without requiring degradation labels or explicit density modeling. To anchor the learned geometry, we estimate a pristine prototype from clean training embeddings, defining a nominal operating point in representation space. Self-awareness emerges as geometric deviation from this reference, providing an intrinsic, image-level signal of degradation-induced shift that is independent of detection confidence. Extensive experiments on synthetic corruption benchmarks, cross-dataset zero-shot transfer, and natural weather-induced distribution shifts demonstrate strong pristine-degraded separability, consistent behavior across multiple detector architectures, and robust generalization under semantic shift. These results suggest that degradation-aware representation geometry provides a practical and detector-agnostic foundation.

目标检测自知系统退化建模流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。