提出新方法缓解图神经网络持续学习中的遗忘问题。
Instance-Prototype Affinity Learning for Non-Exemplar Continual Graph Learning
- 用实例与原型的亲和性学习,结合图结构增强记忆
- 在4个数据集上优于现有方法,平衡了学习新知识与保留旧知识
- 适合需要隐私保护的持续学习场景
图神经网络在持续学习中易发生灾难性遗忘,传统基于回放的方法存在内存爆炸和隐私泄露问题。非示例方法通过原型回放(PR)规避上述问题,但面临特征漂移挑战。本文发现原型对比学习(PCL)漂移更小。据此提出实例-原型亲和性学习(IPAL),利用图结构信息构建拓扑集成高斯原型(TIGP),引导特征分布聚焦高影响节点,提升新知识吸收能力;通过实例-原型亲和性蒸馏(IPAD)正则化类别关系断层,保护任务记忆;并在PCL中嵌入决策边界感知(DBP)机制,增强类别间可分性。在4个节点分类基准数据集上的实验表明,该方法优于现有最先进方法,在可塑性与稳定性间取得更好平衡。
原文摘要 · Abstract (English)
Graph Neural Networks (GNN) endure catastrophic forgetting, undermining their capacity to preserve previously acquired knowledge amid the assimilation of novel information. Rehearsal-based techniques revisit historical examples, adopted as a principal strategy to alleviate this phenomenon. However, memory explosion and privacy infringements impose significant constraints on their utility. Non-Exemplar methods circumvent the prior issues through Prototype Replay (PR), yet feature drift presents new challenges. In this paper, our empirical findings reveal that Prototype Contrastive Learning (PCL) exhibits less pronounced drift than conventional PR. Drawing upon PCL, we propose Instance-Prototype Affinity Learning (IPAL), a novel paradigm for Non-Exemplar Continual Graph Learning (NECGL). Exploiting graph structural information, we formulate Topology-Integrated Gaussian Prototypes (TIGP), guiding feature distributions towards high-impact nodes to augment the model's capacity for assimilating new knowledge. Instance-Prototype Affinity Distillation (IPAD) safeguards task memory by regularizing discontinuities in class relationships. Moreover, we embed a Decision Boundary Perception (DBP) mechanism within PCL, fostering greater inter-class discriminability. Evaluations on four node classification benchmark datasets demonstrate that our method outperforms existing state-of-the-art methods, achieving a better trade-off between plasticity and stability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。