arXiv:2412.07219cs.CVcs.LG2024-12被引 3

让模型在含混杂数据的异常样本中训练,仍能准确识别分布外数据。

Taylor Outlier Exposure

  • 用泰勒展开重构正则项,动态调节对正常数据的惩罚强度。
  • 在含噪声异常数据上训练,性能仍优于传统方法。
  • 适合缺乏纯净异常数据集的研究者使用。

分布外(OOD)检测旨在识别训练时未见的数据分布,对提升机器学习系统的可靠性至关重要。现有方法中,异常暴露(OE)通过引入辅助的异常数据显著增强模型的检测能力与泛化性能。然而,构建不含正常数据的纯净异常数据集对OE极为关键;若辅助数据集被正常样本污染,将严重影响训练过程和最终效果。随着数据规模增大,生成纯净异常数据的成本急剧上升。为此,本文提出泰勒异常暴露(TaylorOE),一种基于OE的正则化方法,可直接在含正常样本污染的异常数据上训练。通过泰勒展开将OE正则项表示为多项式函数,仅需调整展开阶数即可控制对正常数据的正则化强度。实验表明,该方法在含噪与纯净异常数据集上均显著优于现有方法,并验证了正则项的有效性。代码已公开于https://github.com/fukuchan41/TaylorOE。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization capabilities. Among OOD detection methods, Outlier Exposure (OE) significantly enhances OOD detection performance and generalization ability by exposing auxiliary OOD data to the model. However, constructing clean auxiliary OOD datasets, uncontaminated by in-distribution (ID) samples, is essential for OE; generally, a noisy OOD dataset contaminated with ID samples negatively impacts OE training dynamics and final detection performance. Furthermore, as dataset scale increases, constructing clean OOD data becomes increasingly challenging and costly. To address these challenges, we propose Taylor Outlier Exposure (TaylorOE), an OE-based approach with regularization that allows training on noisy OOD datasets contaminated with ID samples. Specifically, we represent the OE regularization term as a polynomial function via a Taylor expansion, allowing us to control the regularization strength for ID data in the auxiliary OOD dataset by adjusting the order of Taylor expansion. In our experiments on the OOD detection task with clean and noisy OOD datasets, we demonstrate that the proposed method consistently outperforms conventional methods and analyze our regularization term to show its effectiveness. Our implementation code of TaylorOE is available at \url{https://github.com/fukuchan41/TaylorOE}.

OOD检测异常暴露正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。