arXiv:2605.30135cs.LGcs.AI2026-05

DAMEL通过双轴专家学习,同时降低长尾数据的预测偏差与方差。

DAMEL: Dual-Axis Multi-Expert Learning for Class-Imbalanced Learning

论文配图:DAMEL: Dual-Axis Multi-Expert Learning for Class-Imbalanced Learning
图 1 · 摘自论文原文
  • 沿表征与时间双轴引入多专家,融合多模型能力
  • 在长尾数据上实现更低偏差与方差,提升泛化性能
  • 适合处理真实世界中的长尾分布数据,如医疗分类

针对现实世界中具有长尾分布的数据,已有多种算法用于缓解类别不平衡问题。尽管这些方法通过重平衡技术减少了预测偏差,但常伴随预测方差增加的代价。部分多专家学习算法试图缓解这一问题,但流程复杂。本文提出一种新的多专家学习算法——双轴多专家学习(DAMEL),通过在表征轴和时间轴上使用多个专家,同时降低预测偏差与方差。在表征轴上,DAMEL拼接多个专家的表征,并联合训练一个辅助的平衡分类器;在时间轴上,聚合训练过程中的网络权重,并在测试时使用。实验表明,DAMEL能有效降低预测偏差与方差,显著提升类别不平衡学习效果。

原文摘要 · Abstract (English)

Various algorithms have been proposed to address the challenges posed by class-imbalanced learning from real-world data with long-tailed distributions. While these algorithms reduce prediction bias through rebalancing techniques, they often introduce increased prediction variance as a trade-off. Several multi-expert learning algorithms aim to address this variance but involve complex procedures. We propose a new multi-expert learning algorithm, called the dual-axis multi-expert learning (DAMEL), which reduces both bias and variance of predictions by using multiple experts along both representation and time axes. Along the representation axis, DAMEL concatenates the representations of multiple experts and trains an auxiliary balanced classifier simultaneously with the concatenated representations. Along the time axis, DAMEL aggregates network weights across training epochs, employing these aggregated weights during testing. Experimental results demonstrate that DAMEL reduces both bias and variance of predictions, highlighting its effectiveness in class-imbalanced learning.

类别不平衡多专家学习长尾分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。