通过中间层重构差异提升模型在分布偏移下的不确定性估计可靠性
Robust Uncertainty Estimation under Distribution Shift via Difference Reconstruction
- 用双中间层重构输出的差异作为不确定度评分
- 在多个分布偏移数据集上优于现有方法,AUC和AUPR均更优
- 适用于医疗影像等高风险场景的可信决策支持
深度学习模型的不确定性估计对医疗影像等高风险应用中的可靠决策至关重要。以往研究发现,输入样本与其由辅助模型生成的重构版本之间的差异可作为不确定性代理指标。然而,直接比较原图与重构图会因信息丢失和对表面细节的敏感而效果下降。本文提出差分重构不确定性估计(DRUE),通过从两个中间层重建输入,并测量其输出差异作为不确定性分数,缓解该问题。为评估实际表现,采用广泛使用的分布外(OOD)检测范式,以青光眼检测为分布内(ID)任务,对比具有不同程度领域偏移的多个外部数据集。实验表明,DRUE在多个OOD数据集上持续取得更高的AUC与AUPR,凸显其在分布偏移下的鲁棒性与可靠性。本工作提供了一种原理清晰且有效的框架,增强模型在不确定环境中的可靠性。
原文摘要 · Abstract (English)
Estimating uncertainty in deep learning models is critical for reliable decision-making in high-stakes applications such as medical imaging. Prior research has established that the difference between an input sample and its reconstructed version produced by an auxiliary model can serve as a useful proxy for uncertainty. However, directly comparing reconstructions with the original input is degraded by information loss and sensitivity to superficial details, which limits its effectiveness. In this work, we propose Difference Reconstruction Uncertainty Estimation (DRUE), a method that mitigates this limitation by reconstructing inputs from two intermediate layers and measuring the discrepancy between their outputs as the uncertainty score. To evaluate uncertainty estimation in practice, we follow the widely used out-of-distribution (OOD) detection paradigm, where in-distribution (ID) training data are compared against datasets with increasing domain shift. Using glaucoma detection as the ID task, we demonstrate that DRUE consistently achieves superior AUC and AUPR across multiple OOD datasets, highlighting its robustness and reliability under distribution shift. This work provides a principled and effective framework for enhancing model reliability in uncertain environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。