arXiv:2605.28630cs.CVcs.MM2026-05

用结构熵动态路由,让模型更准识别不同类型的异常。

EntroAD: Structural Entropy-Guided Prompt Adaptation for Zero-Shot Anomaly Detection

论文配图:EntroAD: Structural Entropy-Guided Prompt Adaptation for Zero-Shot Anomaly Detection
图 1 · 摘自论文原文
  • 根据图像块间关系的结构熵,动态选择适配策略。
  • 在10个工业与医疗数据集上达到当前最好效果。
  • 适合处理复杂多变的未知异常,如局部断裂或细微变异。

零样本异常检测(ZSAD)旨在无需目标域微调的情况下检测未见场景中的异常。近期基于CLIP的方法通过提示学习和视觉-文本对齐取得了良好效果。但多数方法依赖单一适配路径,难以应对跨域异常模式的异质性。实际中,异常表现形式多样,从显著的局部结构性破坏到细微、弥散且不规则的变化不等。为此,我们提出EntroAD,一种基于结构熵引导的零样本异常检测框架。不同于以往方法,EntroAD引入动态路由机制,针对不同类型异常采用专用适配策略。具体地,通过自注意力生成的块间关系估计块级结构熵,作为关系不确定性的代理信号,指导感知异常的令牌路由。基于此路由信号,构建感知异常的路由令牌,以更好捕捉具有不同结构特征的异常线索。此外,引入置信度感知的双分支提示适配模块,在稳定视觉-文本对齐的同时保留CLIP的可迁移先验。在10个工业与医学基准上的大量实验表明,EntroAD在具有挑战性的跨数据集ZSAD设置下取得最先进性能。

原文摘要 · Abstract (English)

Zero-Shot Anomaly Detection (ZSAD) aims to detect anomalies in unseen domains without target-domain adaptation. Recent CLIP-based methods have shown promising performance by leveraging prompt learning and visual-text alignment. However, most existing approaches rely on a single adaptation pathway, which may be insufficient for heterogeneous anomaly patterns across domains. In practice, anomalies exhibit vastly different characteristics, ranging from salient, localized structural disruptions to subtle, diffuse, and irregular variations. To address this challenge, we propose EntroAD, a structural entropy-guided zero-shot anomaly detection framework. Unlike previous methods, EntroAD introduces a dynamic routing mechanism to process different types of anomalies with specialized adaptation strategies. Specifically, we estimate patch-level structural entropy from self-attention-induced patch relations and use it as a proxy for relational uncertainty to guide anomaly-aware token routing. Based on this routing signal, we construct anomaly-aware routed tokens to better capture anomaly cues with different structural characteristics. We further introduce a confidence-aware dual-branch prompt adaptation module to stabilize visual-text alignment while preserving CLIP's transferable prior. Extensive experiments on 10 industrial and medical benchmarks show that EntroAD achieves state-of-the-art performance in challenging cross-dataset ZSAD settings.

异常检测零样本CLIP结构熵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。