提出条件兼容性学习,让模型判断物体是否与场景匹配。
Conditional Compatibility Learning for Context-Dependent Anomaly Detection
- 分离主体与上下文表征,通过文本引导注意力融合信息
- 在真实场景中显著优于现有基于CLIP的异常检测方法
- 适合需要理解场景语义关系的工业质检等应用
传统异常检测假设异常是观察对象的固有属性,但现实中许多异常依赖于上下文:如跑步者在跑道上正常,但在高速公路上则异常。这种情境异常检测长期未被现代视觉语言系统充分探索。问题本质在于形式不可识别性——当异常标签依赖于主体与上下文的关系时,任何融合主体与上下文全局表示的模型都无法正确区分不同配置。为此,本文提出条件兼容性学习框架,要求模型判断主体是否与当前上下文兼容。我们构建了CC-CLIP模型,从单张图像中学习解耦的主体与上下文感知表征,并通过文本条件注意力融合视觉证据。在真实世界情境异常检测任务上,CC-CLIP性能显著超越所有现有基于CLIP及上下文推理的方法;其单分支变体也在结构异常检测基准上表现优异。
原文摘要 · Abstract (English)
Anomaly detection usually assumes that abnormality is an intrinsic property of an observation. A defect is a defect, and a rare object is rare, regardless of where it appears. Many real-world anomalies do not work this way. A runner on a track is normal, but the same runner on a highway is not. The subject is unchanged; only the context makes it anomalous. This setting, long recognized as contextual anomaly detection, remains largely underexplored in modern vision-language systems. The difficulty is not merely empirical; it is formal. When anomaly labels depend on the relation between a subject and its context, any detector reasoning from a global representation that conflates subject and context is provably non-identifiable: two different subject-context configurations can map to the same embedding while requiring opposite labels, and no such detector can be correct on both. This impossibility motivates a different formulation: instead of asking whether an observation deviates from a global notion of normality, the model should ask whether subjects are compatible with their surrounding context. We define this as conditional compatibility learning. We instantiate this framework in CC-CLIP, a vision-language architecture that learns disentangled subject- and context-aware representations from a single image and fuses visual evidence through text-conditioned attention. CC-CLIP achieves state-of-the-art results on real-world contextual anomaly detection, substantially outperforming all existing CLIP-based and context-reasoning baselines. A single-branch variant of CC-CLIP also achieves competitive performance on structural anomaly benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。