让模型学会何时该不确定,提升可靠性。
Guided Uncertainty Learning Using a Post-Hoc Evidential Meta-Model
- 通过校准阶段识别关键特征,构建噪声引导的教学课程
- 在不重新训练的情况下,分布外检测能力提升77%
- 无需修改模型结构,适合快速部署到各类预训练模型
可靠地量化不确定性仍是深度学习模型在分布外场景下部署的主要障碍。现有后处理方法要么继承原有模型的错误置信度,要么仅调整预测结果,未能教会模型何时应表达不确定性。我们提出GUIDE,一种轻量级的证据学习元模型方法,可附加于冻结的深度学习模型之上,显式学习模型何时以及如何表达不确定性。GUIDE通过校准阶段识别显著内部特征,并利用这些特征构建噪声驱动的课程,指导模型学习不确定性表达。GUIDE无需重训练、无需架构修改、无需人工选择中间层,确保广泛适用性和最小用户干预。所得到的模型避免了从基础模型中继承过度自信,使分布外检测性能提升约77%,对抗攻击检测能力提升约80%,同时保持分布内性能。在多个基准测试中,GUIDE始终优于当前最先进方法,证明主动引导不确定性对缩小预测置信与可靠性差距至关重要。
原文摘要 · Abstract (English)
Reliable uncertainty quantification remains a major obstacle to the deployment of deep learning models under distributional shift. Existing post-hoc approaches that retrofit pretrained models either inherit misplaced confidence or merely reshape predictions, without teaching the model when to be uncertain. We introduce GUIDE, a lightweight evidential learning meta-model approach that attaches to a frozen deep learning model and explicitly learns how and when to be uncertain. GUIDE identifies salient internal features via a calibration stage, and then employs these features to construct a noise-driven curriculum that teaches the model how and when to express uncertainty. GUIDE requires no retraining, no architectural modifications, and no manual intermediate-layer selection to the base deep learning model, thus ensuring broad applicability and minimal user intervention. The resulting model avoids distilling overconfidence from the base model, improves out-of-distribution detection by ~77% and adversarial attack detection by ~80%, while preserving in-distribution performance. Across diverse benchmarks, GUIDE consistently outperforms state-of-the-art approaches, evidencing the need for actively guiding uncertainty to close the gap between predictive confidence and reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。