提出一种能应对测试数据分布偏移的动态模型融合方法,提升多任务模型在真实场景下的可靠性。
BD-Merging: Bias-Aware Dynamic Model Merging with Evidence-Guided Contrastive Learning
- 通过联合证据头建模不确定性,捕捉跨任务语义关联
- 设计邻近差异评分量化样本间证据一致性,指导模型优化
- 适合在数据分布变化时保持性能的多任务系统部署
模型融合(MM)已成为一种可扩展的多任务学习范式,可在不重新访问原始训练数据的情况下整合多个特定任务模型。尽管已有进展,但现有方法在测试时分布偏移下的可靠性仍不充分。多数方法假设测试数据干净且与训练及辅助源数据分布一致,而实际中这一假设往往不成立,导致预测偏差和泛化能力下降。为此,本文提出BD-Merging,一种面向偏移的无监督模型融合框架,通过显式建模不确定性实现自适应可靠性。首先,引入联合证据头,在统一标签空间中学习不确定性,捕捉融合过程中的跨任务语义依赖。其次,基于该证据基础,提出邻近差异评分(ADS),量化相邻样本间的证据一致性。第三,利用ADS引导的差异感知对比学习机制,对齐一致样本、分离冲突样本,从而优化融合表示。结合通用无监督学习,该过程训练出一个去偏路由器,可根据样本动态分配任务或层级权重,有效缓解分布偏移带来的负面影响。在多种任务上的大量实验表明,BD-Merging相比当前最优基线展现出更优的有效性与鲁棒性。
原文摘要 · Abstract (English)
Model Merging (MM) has emerged as a scalable paradigm for multi-task learning (MTL), enabling multiple task-specific models to be integrated without revisiting the original training data. Despite recent progress, the reliability of MM under test-time distribution shift remains insufficiently understood. Most existing MM methods typically assume that test data are clean and distributionally aligned with both the training and auxiliary sources. However, this assumption rarely holds in practice, often resulting in biased predictions with degraded generalization. To address this issue, we present BD-Merging, a bias-aware unsupervised model merging framework that explicitly models uncertainty to achieve adaptive reliability under distribution shift. First, BD-Merging introduces a joint evidential head that learns uncertainty over a unified label space, capturing cross-task semantic dependencies in MM. Second, building upon this evidential foundation, we propose an Adjacency Discrepancy Score (ADS) that quantifies evidential alignment among neighboring samples. Third, guided by ADS, a discrepancy-aware contrastive learning mechanism refines the merged representation by aligning consistent samples and separating conflicting ones. Combined with general unsupervised learning, this process trains a debiased router that adaptively allocates task-specific or layer-specific weights on a per-sample basis, effectively mitigating the adverse effects of distribution shift. Extensive experiments across diverse tasks demonstrate that BD-Merging achieves superior effectiveness and robustness compared to state-of-the-art MM baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。