arXiv:2507.07100cs.LGcs.CV2025-07ICML被引 16

解决领域增量学习中数据不平衡问题,提升小样本类表现。

Addressing Imbalanced Domain-Incremental Learning through Dual-Balance Collaborative Experts

  • 用频率感知专家组和专用损失函数缓解类内不平衡。
  • 通过均衡高斯采样生成伪特征,动态选择专家以平衡新旧知识。
  • 在多个数据集上超越现有方法,适合持续学习场景使用。

领域增量学习(DIL)关注非平稳环境中的持续学习,要求模型在适应不断变化的领域的同时保留历史知识。但在数据不平衡背景下,面临两大挑战:领域内类别不平衡和跨领域分布偏移。前者导致少样本类欠拟合,后者需兼顾旧领域多样本类的知识保持与新数据对旧领域少样本类性能的提升。为此,本文提出双平衡协作专家(DCE)框架。DCE采用频率感知专家组,每个专家由特定损失函数引导,学习特定频次组的特征,有效缓解领域内不平衡。随后,通过从历史类别统计中进行均衡高斯采样合成伪特征,学习动态专家选择器,权衡旧领域多样本知识保持与新数据对旧领域少样本类性能的提升。在四个基准数据集上的大量实验表明,DCE达到当前最优性能。

原文摘要 · Abstract (English)

Domain-Incremental Learning (DIL) focuses on continual learning in non-stationary environments, requiring models to adjust to evolving domains while preserving historical knowledge. DIL faces two critical challenges in the context of imbalanced data: intra-domain class imbalance and cross-domain class distribution shifts. These challenges significantly hinder model performance, as intra-domain imbalance leads to underfitting of few-shot classes, while cross-domain shifts require maintaining well-learned many-shot classes and transferring knowledge to improve few-shot class performance in old domains. To overcome these challenges, we introduce the Dual-Balance Collaborative Experts (DCE) framework. DCE employs a frequency-aware expert group, where each expert is guided by specialized loss functions to learn features for specific frequency groups, effectively addressing intra-domain class imbalance. Subsequently, a dynamic expert selector is learned by synthesizing pseudo-features through balanced Gaussian sampling from historical class statistics. This mechanism navigates the trade-off between preserving many-shot knowledge of previous domains and leveraging new data to improve few-shot class performance in earlier tasks. Extensive experimental results on four benchmark datasets demonstrate DCE's state-of-the-art performance.

增量学习数据不平衡专家系统持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。