arXiv:2602.21372cs.LGcs.AI2026-02

医疗影像模型在线融合,自适应调整权重提升泛化能力

The Mean is the Mirage: Entropy-Adaptive Model Merging under Heterogeneous Domain Shifts in Medical Imaging

  • 根据目标数据熵动态调整模型融合权重,实现在线自适应
  • 在9个数据集上均优于平均融合,尤其在非独立同分布场景下优势明显
  • 适合部署于不同设备、协议的临床场景,无需标注即可快速适应

在未知测试分布变化下,传统模型平均融合方法往往失效。这一问题在医疗影像中尤为突出:各诊所基于本地私有数据微调模型,导致模型因扫描仪、成像协议和人群差异而产生领域特异性。当模型部署到新临床站点时,测试样本以无标签、非独立同分布的批次形式到达,必须在无标签情况下立即适应。本文提出一种基于熵自适应的全在线模型融合方法,仅通过前向传播即可生成针对每批数据的合并模型,有效利用目标信息。我们进一步揭示了平均融合在异质领域偏移下易失败且不一致的原因。通过解耦编码器与分类头,并采用独立融合系数,缓解了编码器-分类器失配问题。我们在两种主干网络上,使用九个医学与自然域泛化图像分类数据集,对最新基线方法进行广泛评估,结果表明该方法在标准与挑战性场景下均具持续提升。性能提升同时保持单模型推理,验证了方法的有效性。

原文摘要 · Abstract (English)

Model merging under unseen test-time distribution shifts often renders naive strategies, such as mean averaging unreliable. This challenge is especially acute in medical imaging, where models are fine-tuned locally at clinics on private data, producing domain-specific models that differ by scanner, protocol, and population. When deployed at an unseen clinical site, test cases arrive in unlabeled, non-i.i.d. batches, and the model must adapt immediately without labels. In this work, we introduce an entropy-adaptive, fully online model-merging method that yields a batch-specific merged model via only forward passes, effectively leveraging target information. We further demonstrate why mean merging is prone to failure and misaligned under heterogeneous domain shifts. Next, we mitigate encoder classifier mismatch by decoupling the encoder and classification head, merging with separate merging coefficients. We extensively evaluate our method with state-of-the-art baselines using two backbones across nine medical and natural-domain generalization image classification datasets, showing consistent gains across standard evaluation and challenging scenarios. These performance gains are achieved while retaining single-model inference at test-time, thereby demonstrating the effectiveness of our method.

模型融合医疗影像自适应在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。