用自适应生成的异常样本提升图像异常检测在对抗环境下的鲁棒性。
RODEO: Robust Outlier Detection via Exposing Adaptive Out-of-Distribution Samples
- 基于文本-图像模型生成兼具多样性与分布相似性的异常样本。
- 在对抗设置下,检测准确率显著提升,尤其对未见过的异常样本。
- 适合需要高鲁棒性的工业质检、自动驾驶等安全敏感场景。
近年来,图像异常检测取得了显著进展,但在对抗性设置下的表现仍远低于标准设置。这主要是由于训练过程中缺乏对对抗场景的有效暴露,特别是对未见过的异常样本,导致检测模型难以学习鲁棒特征。为此,我们提出RODEO,一种以数据为中心的方法,通过生成有效的异常样本实现鲁棒的异常检测。具体而言,我们证明结合异常暴露(OE)与对抗训练是有效策略,前提是暴露的训练异常样本具备多样性,且在概念上与正常样本具有差异性与类比性。我们利用文本到图像模型实现这一目标。实验表明,该自适应异常暴露方法能有效生成‘多样化’且‘近分布’的异常样本,充分利用文本与图像域信息。定量与定性结果均显示,使用合成异常样本可显著提升检测器性能,尤其是在对抗性设置下。
原文摘要 · Abstract (English)
In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of effective exposure to adversarial scenarios during training, especially on unseen outliers, leading to detection models failing to learn robust features. To bridge this gap, we introduce RODEO, a data-centric approach that generates effective outliers for robust outlier detection. More specifically, we show that incorporating outlier exposure (OE) and adversarial training can be an effective strategy for this purpose, as long as the exposed training outliers meet certain characteristics, including diversity, and both conceptual differentiability and analogy to the inlier samples. We leverage a text-to-image model to achieve this goal. We demonstrate both quantitatively and qualitatively that our adaptive OE method effectively generates ``diverse'' and ``near-distribution'' outliers, leveraging information from both text and image domains. Moreover, our experimental results show that utilizing our synthesized outliers significantly enhances the performance of the outlier detector, particularly in adversarial settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。