提出新框架提升小样本异常检测泛化能力
Generalized Few-Shot Out-of-Distribution Detection
- 用辅助通用模型提供先验知识,避免过拟合小样本数据
- 理论证明平衡通用与特定知识可降低泛化误差上限
- 动态调整知识引导,适合跨场景异常检测应用
小样本异常检测(OOD)已成为机器学习实际部署中的关键方向。现有方法因受限于少样本学习范式,常过度拟合训练数据,导致在泛化数据上性能下降且不同场景表现不一致。为此,我们提出通用小样本异常检测(GOOD)框架,通过引入辅助通用知识模型(GKM)赋予检测模型通用知识,而非直接从少样本数据中学习。我们从泛化视角分析小样本OOD检测,理论上推导出通用性-特异性平衡(GS-balance),证明其可降低泛化误差上界。进一步提出知识动态嵌入(KDE)机制,基于GKM的广义信念(G-Belief)动态调节检测模型输出分布,增强GS-balance。在真实世界OOD基准上的实验表明该方法显著优于现有方法。代码将公开。
原文摘要 · Abstract (English)
Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the open world. Due to the few-shot learning paradigm, the OOD detection ability is often overfit to the limited training data itself, thus degrading the performance on generalized data and performing inconsistently across different scenarios. To address this challenge, we proposed a Generalized Few-shot OOD Detection (GOOD) framework, which empowers the general knowledge of the OOD detection model with an auxiliary General Knowledge Model (GKM), instead of directly learning from few-shot data. We proceed to reveal the few-shot OOD detection from a generalization perspective and theoretically derive the Generality-Specificity balance (GS-balance) for OOD detection, which provably reduces the upper bound of generalization error with a general knowledge model. Accordingly, we propose a Knowledge Dynamic Embedding (KDE) mechanism to adaptively modulate the guidance of general knowledge. KDE dynamically aligns the output distributions of the OOD detection model to the general knowledge model based on the Generalized Belief (G-Belief) of GKM, thereby boosting the GS-balance. Experiments on real-world OOD benchmarks demonstrate our superiority. Codes will be available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。