arXiv:2603.18764cs.CV2026-03被引 1

解决无源域适应中邻居预测过拟合问题,提升模型泛化能力

ProCal: Probability Calibration for Neighborhood-Guided Source-Free Domain Adaptation

  • 通过双模型协作动态校准邻居预测概率
  • 在31个跨域任务上实现平均性能提升2.1%以上
  • 适合需要稳定迁移且无源数据的场景

无源域适应(SFDA)在不访问源数据的情况下,将预训练模型适配到未标注的目标域。尽管基于局部邻域结构的先进方法在SFDA中表现良好,但其过度依赖邻域间预测相似性,导致源知识遗忘加速并加剧对局部噪声的过拟合。为此,本文提出ProCal,一种概率校准方法,通过双模型协同预测机制动态校准基于邻域的预测结果。ProCal将源模型的初始预测与当前模型的在线输出融合,有效校准邻居概率,既缓解了局部噪声干扰,又保留了源模型的判别信息,实现了知识保留与域适应的平衡。此外,设计了结合软监督损失与多样性损失的联合优化目标。理论分析表明,ProCal收敛至源知识与目标信息有效融合的平衡点,降低了知识遗忘和过拟合风险。在四个公开数据集的31个跨域任务上进行了大量实验验证,结果表明该方法显著提升性能。

原文摘要 · Abstract (English)

Source-Free Domain Adaptation (SFDA) adapts pre-trained models to unlabeled target domains without requiring access to source data. Although state-of-the-art methods leveraging local neighborhood structures show promise for SFDA, they tend to over-rely on prediction similarity among neighbors. This over-reliance accelerates the forgetting of source knowledge and increases susceptibility to local noise overfitting. To address these issues, we introduce ProCal, a probability calibration method that dynamically calibrates neighborhood-based predictions through a dual-model collaborative prediction mechanism. ProCal integrates the source model's initial predictions with the current model's online outputs to effectively calibrate neighbor probabilities. This strategy not only mitigates the interference of local noise but also preserves the discriminative information from the source model, thereby achieving a balance between knowledge retention and domain adaptation. Furthermore, we design a joint optimization objective that combines a soft supervision loss with a diversity loss to guide the target model. Our theoretical analysis shows that ProCal converges to an equilibrium where source knowledge and target information are effectively fused, reducing both knowledge forgetting and overfitting. We validate the effectiveness of our approach through extensive experiments on 31 cross-domain tasks across four public datasets. Our code is available at: https://github.com/zhengyinghit/ProCal.

域适应概率校准无源迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。