医学影像中,熵最小化会加剧预测偏差,新方法有效缓解此问题。
Entropy Minimization without Model Collapse: Mitigating Prediction Bias in Medical Imaging

- 提出针对预测偏差的无模型坍塌熵最小化方法
- 在四组医学影像数据上稳定适应,避免预测全集中于单一类别
- 仅需测试时运行,适合临床部署场景
熵最小化(EM)是测试时自适应的主流目标,但其模型坍塌失效机制仍不明确。本文发现,分布偏移会导致模型表征空间中不同类别的特征簇合并,而决策边界保持不变,引发系统性预测偏差——部分类别被高估,另一些被压制。熵最小化通过紧缩已有簇,强化错误聚类,最终导致所有预测坍缩为平凡解。为此,我们提出分布偏移偏差纠正(DSBR),通过均衡各预测类别对无监督熵最小化损失的贡献,专门应对这一失效模式。我们在四个医学影像数据集及ImageNet-C上验证该方法,结果表明DSBR能持续稳定测试时自适应,防止模型坍塌,性能达或优于现有最优方法。且DSBR仅在测试阶段运行。
原文摘要 · Abstract (English)
Entropy minimization (EM) is the dominant objective for test-time adaptation, yet its failure mode, model collapse, remains poorly understood. In this work, we show that distribution shifts can cause feature clusters corresponding to distinct classes in the model's representation space to merge, while the decision boundary remains fixed. This induces a systematic skew in the predicted class distribution, referred to as prediction bias. Prediction bias refers to a shift in the predicted class distribution, with some classes overrepresented and others suppressed. We show that entropy minimization amplifies this prediction bias by tightening the existing clusters, reinforcing the incorrect groupings until all predictions collapse to a trivial solution. Next, to demonstrate the significance of prediction bias and mitigate it, we further propose Distribution Shift Bias Reduction (DSBR), a bias-correcting objective that specifically targets this failure mode by equalizing the contribution of each predicted class to the unsupervised entropy minimization loss. To study this failure mode, we design suitable adaptation settings using four medical-imaging datasets and additionally evaluate on ImageNet-C. We find that DSBR consistently stabilizes test-time adaptation, prevents model collapse, and matches or outperforms state-of-the-art methods. Moreover, DSBR operates solely at test-time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。