提出新方法应对风格变化下的异常检测失效问题
A Contrastive Teacher-Student Framework for Novelty Detection under Style Shifts
- 用风格相似但核心特征不同的伪造异常样本训练模型
- 通过任务导向的知识蒸馏让模型聚焦核心特征而非风格
- 在多个真实与合成数据集上优于9种现有方法
尽管已有多种异常检测(ND)方法,但在环境变化引起的微小分布偏移(即风格偏移)下,其性能常显著下降。这是因为训练时缺乏外部分布(OOD)样本,导致检测器偏向于学习内分布(ID)数据中的主导风格特征,误将风格当作关键判别特征,形成捷径依赖。这在自动驾驶、医学影像等实际场景中尤为关键。为此,我们提出一种鲁棒的异常检测方法:构建一个辅助的OOD数据集,其风格特征与ID数据相似,但核心特征不同;再采用任务导向的知识蒸馏策略,帮助模型区分核心特征与风格特征,从而依靠核心特征来判断真伪。我们在多个数据集(包括合成和真实世界基准)上进行了广泛实验,对比了九种现有方法,验证了该方法的有效性。
原文摘要 · Abstract (English)
There have been several efforts to improve Novelty Detection (ND) performance. However, ND methods often suffer significant performance drops under minor distribution shifts caused by changes in the environment, known as style shifts. This challenge arises from the ND setup, where the absence of out-of-distribution (OOD) samples during training causes the detector to be biased toward the dominant style features in the in-distribution (ID) data. As a result, the model mistakenly learns to correlate style with core features, using this shortcut for detection. Robust ND is crucial for real-world applications like autonomous driving and medical imaging, where test samples may have different styles than the training data. Motivated by this, we propose a robust ND method that crafts an auxiliary OOD set with style features similar to the ID set but with different core features. Then, a task-based knowledge distillation strategy is utilized to distinguish core features from style features and help our model rely on core features for discriminating crafted OOD and ID sets. We verified the effectiveness of our method through extensive experimental evaluations on several datasets, including synthetic and real-world benchmarks, against nine different ND methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。