arXiv:2512.10818cs.CV2025-12

针对噪声数据下的领域泛化,提出自集成后处理方法提升模型鲁棒性。

Self-Ensemble Post Learning for Noisy Domain Generalization

论文配图:Self-Ensemble Post Learning for Noisy Domain Generalization
图 1 · 摘自论文原文
  • 利用模型中间特征设计多探针分类器,实现特征多样性挖掘。
  • 在噪声标签下通过半监督训练探针分类器,提升预测稳定性。
  • 采用众包式集成推理融合多分类头输出,适合真实场景应用。

尽管计算机视觉和机器学习取得显著进展,其鲁棒性仍面临数据分布偏移与标签噪声两大挑战。当领域泛化(DG)遭遇噪声时,标签噪声会加剧深层特征中伪特征的放大,导致现有算法性能下降。本文从领域泛化出发,研究现有方法在噪声环境下的重调优策略。发现模型内部潜在特征具有一定的判别能力,且不同特征关注图像不同区域。基于此,提出自集成后学习方法(SEPL),通过特征探测训练与预测集成推理两部分实现特征多样化利用。具体地,利用模型架构中的中间特征表示,训练多个探测分类器以充分挖掘预训练模型能力,最终预测通过整合多个分类头输出获得。考虑到标签噪声,采用半监督算法训练探测分类器。由于不同探测分类器关注区域各异,使用众包式推理方式融合其预测结果。大量实验表明,该方法不仅增强现有方法的鲁棒性,更在高灵活性的真实场景应用中展现出显著潜力。

原文摘要 · Abstract (English)

While computer vision and machine learning have made great progress, their robustness is still challenged by two key issues: data distribution shift and label noise. When domain generalization (DG) encounters noise, noisy labels further exacerbate the emergence of spurious features in deep layers, i.e. spurious feature enlargement, leading to a degradation in the performance of existing algorithms. This paper, starting from domain generalization, explores how to make existing methods rework when meeting noise. We find that the latent features inside the model have certain discriminative capabilities, and different latent features focus on different parts of the image. Based on these observations, we propose the Self-Ensemble Post Learning approach (SEPL) to diversify features which can be leveraged. Specifically, SEPL consists of two parts: feature probing training and prediction ensemble inference. It leverages intermediate feature representations within the model architecture, training multiple probing classifiers to fully exploit the capabilities of pre-trained models, while the final predictions are obtained through the integration of outputs from these diverse classification heads. Considering the presence of noisy labels, we employ semi-supervised algorithms to train probing classifiers. Given that different probing classifiers focus on different areas, we integrate their predictions using a crowdsourcing inference approach. Extensive experimental evaluations demonstrate that the proposed method not only enhances the robustness of existing methods but also exhibits significant potential for real-world applications with high flexibility.

领域泛化噪声标签特征集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。