arXiv:2411.13097cs.LGcs.IT2024-11中稿 · the 26th IEEE Inte…

解决标签随时间增加时的增量学习难题,提升模型效率与泛化能力。

Incremental Label Distribution Learning with Scalable Graph Convolutional Networks

  • 提出新标签感知的梯度补偿损失,加速新标签学习。
  • 构建标签关系图,降低重学旧标签的时间开销。
  • 适合动态标签场景如疾病诊断,需持续更新标签体系的领域。

标签分布学习(LDL)能有效处理标签模糊性,同时分析所有标签并量化其对样本的描述程度。现有方法通常假设标签数量固定,但在实际应用中(如疾病诊断),新标签会随时间不断出现,而现有方法忽视了这一动态变化。直接学习新标签需重新训练全部标签,导致旧标签学习耗时增加,且易过拟合。同时,新增标签需重建标签间关系,如何高效利用已构建关系成为关键挑战。为此,本文提出增量标签分布学习(ILDL),分析其在训练样本和标签关系重构中的核心问题,并提出可扩展的图标签分布学习(SGLDL)框架。SGLDL设计了新标签感知的梯度补偿损失,加快新标签学习速度;将标签间关系建模为图结构,显著减少关系重构所需时间。在经典LDL数据集上的实验表明,该方法在效率和性能上均优于现有算法,验证了针对增量标签场景专用设计的重要性。

原文摘要 · Abstract (English)

Label Distribution Learning (LDL) is an effective approach for handling label ambiguity, as it can analyze all labels at once and indicate the extent to which each label describes a given sample. Most existing LDL methods consider the number of labels to be static. However, in various LDL-specific contexts (e.g., disease diagnosis), the label count grows over time (such as the discovery of new diseases), a factor that existing methods overlook. Learning samples with new labels directly means learning all labels at once, thus wasting more time on the old labels and even risking overfitting the old labels. At the same time, learning new labels by the LDL model means reconstructing the inter-label relationships. How to make use of constructed relationships is also a crucial challenge. To tackle these challenges, we introduce Incremental Label Distribution Learning (ILDL), analyze its key issues regarding training samples and inter-label relationships, and propose Scalable Graph Label Distribution Learning (SGLDL) as a practical framework for implementing ILDL. Specifically, in SGLDL, we develop a New-label-aware Gradient Compensation Loss to speed up the learning of new labels and represent inter-label relationships as a graph to reduce the time required to reconstruct inter-label relationships. Experimental results on the classical LDL dataset show the clear advantages of unique algorithms and illustrate the importance of a dedicated design for the ILDL problem.

标签分布增量学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。