动态生成异常样本原型,提升视觉语言模型的异常检测能力。
DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detection

- 仅用正常数据动态构建异常原型,不依赖预设异常标签。
- 在ImageNet OOD上将误报率降低11.60%,准确率提升4.70%。
- 适用于多种模型架构,适合实际部署中的异常检测场景。
近期研究表明,利用大规模语料库中的潜在异常标签作为辅助信息,可提升视觉语言模型的异常检测性能。然而,当真实世界中的异常样本超出预设异常标签集时,现有方法表现不佳。为此,本文提出DynProto,一种在测试阶段仅使用正常数据动态学习异常原型的新方法。该方法基于关键观察:被错误预测为同一正常类别的异常样本在特征空间中倾向于聚集。据此,利用易识别的异常样本作为“锚点”,寻找其更难检测的相似样本。DynProto引入两个模块:粗粒度异常模式捕捉模块在测试时缓存易与正常类别混淆的异常模式;细粒度异常模式精炼模块随后对每个缓存内的模式进行聚类,并聚合为代表性异常原型。通过对比样本与正常及动态异常原型的相似性,实现精准异常检测。DynProto在多个基准上显著优于已有方法,在ImageNet OOD基准上,FPR95降低11.60%,AUROC提升4.70%。该框架与模型架构无关,可适配多种骨干网络。
原文摘要 · Abstract (English)
Recent studies show that using potential out-of-distribution (OOD) labels from large corpora as auxiliary information can improve OOD detection in vision-language models (VLMs). However, these methods often fail when real-world OOD samples fall outside the predefined OOD label set. To address this limitation, we propose DynProto, a novel approach that learns OOD prototypes dynamically during testing using only in-distribution (ID) information. DynProto is inspired by a key observation: OOD samples predicted as the same ID class tend to cluster in the feature space. With this insight, we leverage easy-to-detect OOD samples as ``anchors'' to find their harder-to-detect, similar counterparts. To this end, DynProto introduces two modules: \textbf{Coarse OOD Pattern Capturing Module} caches OOD patterns that are easily confused with each ID class during testing, and \textbf{Fine-grained OOD Pattern Refinement Module} subsequently clusters these patterns within each cache and aggregates them into representative OOD prototypes. By measuring similarity to ID and dynamic OOD prototypes, DynProto enables accurate OOD detection. DynProto significantly outperforms prior methods across multiple benchmarks. On ImageNet OOD benchmark, DynProto reduces FPR95 by 11.60\% and improves AUROC by 4.70\%. Moreover, the framework is architecture-agnostic and can be integrated into various backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。