用扩散模型生成边界外异常数据,提升模型识别能力。
BOOD: Boundary-based Out-Of-Distribution Data Generation
- 基于决策边界附近特征扰动生成高质量异常样本。
- 在CIFAR-100上将平均FPR95降低至10.67%,AUROC达97.42%。
- 适合需要高效训练异常检测模型的研究者使用。
利用扩散模型根据潜在空间特征合成辅助训练数据,可有效提升分布外(OOD)检测性能。然而,由于难以识别类别间的决策边界,从潜在空间中提取有效的分布外特征仍具挑战。本文提出一种名为边界基分布外数据生成(BOOD)的新框架,通过扩散模型合成高质量的分布外特征,并生成符合人类感知的异常图像。BOOD首先从分布内(ID)数据集中学习文本条件化的潜在特征空间,选取靠近决策边界的ID特征并进行扰动以跨过边界形成分布外特征,再通过扩散模型将其解码为像素空间图像。与以往方法相比,该方法在合成信息丰富分布外特征方面更具训练效率,有助于更清晰地区分分布内与分布外数据。在常见基准上的大量实验表明,BOOD显著优于当前最优方法:在CIFAR-100数据集上,平均FPR95下降29.64%(40.31%降至10.67%),平均AUROC提升7.27%(90.15%增至97.42%)。
原文摘要 · Abstract (English)
Harnessing the power of diffusion models to synthesize auxiliary training data based on latent space features has proven effective in enhancing out-of-distribution (OOD) detection performance. However, extracting effective features outside the in-distribution (ID) boundary in latent space remains challenging due to the difficulty of identifying decision boundaries between classes. This paper proposes a novel framework called Boundary-based Out-Of-Distribution data generation (BOOD), which synthesizes high-quality OOD features and generates human-compatible outlier images using diffusion models. BOOD first learns a text-conditioned latent feature space from the ID dataset, selects ID features closest to the decision boundary, and perturbs them to cross the decision boundary to form OOD features. These synthetic OOD features are then decoded into images in pixel space by a diffusion model. Compared to previous works, BOOD provides a more training efficient strategy for synthesizing informative OOD features, facilitating clearer distinctions between ID and OOD data. Extensive experimental results on common benchmarks demonstrate that BOOD surpasses the state-of-the-art method significantly, achieving a 29.64% decrease in average FPR95 (40.31% vs. 10.67%) and a 7.27% improvement in average AUROC (90.15% vs. 97.42%) on the CIFAR-100 dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。