arXiv:2411.06634cs.LG2024-11被引 7

解决图神经网络增量学习中旧类遗忘问题,无需存储历史数据。

Inductive Graph Few-shot Class Incremental Learning

  • 通过多拓扑增强提升模型泛化能力,模拟新类出现时的子图结构。
  • 采用迭代原型校准,改善稀疏标签下新类原型分离效果。
  • 提出旧类原型漂移补偿机制,缓解灾难性遗忘,适合实际部署场景。

在固定标签集下的节点分类已较为成熟,而图少样本增量学习(GFSCIL)则面临节点与类别随时间零星增长的挑战。本文提出归纳式GFSCIL,持续学习新类别的节点,同时不依赖历史数据即可保持旧类性能,克服了需存储完整图数据的可导式设置缺陷。由于无法访问过往数据,归纳式设置加剧了灾难性遗忘与标签稀疏导致的过拟合问题。为此,我们提出基于拓扑的类别增强与原型校准方法(TAP)。首先,设计三分支多拓扑类别增强策略,在基础阶段复现新类子图结构,提升主干网络适应性;其次,针对新类样本稀缺,提出迭代原型校准以增强原型分离;最后,为应对微调引发的特征分布偏移,提出旧类原型漂移补偿机制。我们在四个数据集上验证了该方法的有效性。

原文摘要 · Abstract (English)

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing over time sporadically. We introduce inductive GFSCIL that continually learns novel classes with newly emerging nodes while maintaining performance on old classes without accessing previous data. This addresses the practical concern of transductive GFSCIL, which requires storing the entire graph with historical data. Compared to the transductive GFSCIL, the inductive setting exacerbates catastrophic forgetting due to inaccessible previous data during incremental training, in addition to overfitting issue caused by label sparsity. Thus, we propose a novel method, called Topology-based class Augmentation and Prototype calibration (TAP). To be specific, it first creates a triple-branch multi-topology class augmentation method to enhance model generalization ability. As each incremental session receives a disjoint subgraph with nodes of novel classes, the multi-topology class augmentation method helps replicate such a setting in the base session to boost backbone versatility. In incremental learning, given the limited number of novel class samples, we propose an iterative prototype calibration to improve the separation of class prototypes. Furthermore, as backbone fine-tuning poses the feature distribution drift, prototypes of old classes start failing over time, we propose the prototype shift method for old classes to compensate for the drift. We showcase the proposed method on four datasets.

图神经网络增量学习少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。