arXiv:2604.02633cs.LGcs.AI2026-04被引 1

提出新框架ADR,解决图学习中遗忘与特征漂移问题。

Analytic Drift Resister for Non-Exemplar Continual Graph Learning

  • 用迭代反向传播突破预训练模型冻结限制,提升模型适应性。
  • 通过分层线性融合避免特征漂移,实现理论零遗忘。
  • 适合关注隐私保护和持续学习的图神经网络研究者。

非示例持续图学习(NECGL)通过仅保留类别级原型表示而非原始图样本来消除基于重放范式的隐私风险,以缓解灾难性遗忘。然而这一设计不可避免引发特征漂移。作为新兴替代方案,分析式持续学习(ACL)利用冻结预训练模型的内在泛化能力提升持续学习性能,但存在模型可塑性显著下降的缺陷。为克服上述挑战,本文提出分析式漂移抵抗器(ADR),一种新型且理论严谨的NECGL框架。ADR采用迭代反向传播机制,打破预训练模型冻结约束,使模型能适应不断变化的任务图分布,增强可塑性。由于参数更新会引发特征漂移,我们进一步提出分层分析融合(HAM),通过岭回归对图神经网络中的线性变换进行逐层融合,确保绝对抗特征漂移。在此基础上,分析分类器重构(ACR)实现了理论上的零遗忘增量分类学习。在四个节点分类基准上的实证评估表明,ADR在性能上保持与现有最先进方法相当的竞争力。

原文摘要 · Abstract (English)

Non-Exemplar Continual Graph Learning (NECGL) seeks to eliminate the privacy risks intrinsic to rehearsal-based paradigms by retaining solely class-level prototype representations rather than raw graph examples for mitigating catastrophic forgetting. However, this design choice inevitably precipitates feature drift. As a nascent alternative, Analytic Continual Learning (ACL) capitalizes on the intrinsic generalization properties of frozen pre-trained models to bolster continual learning performance. Nonetheless, a key drawback resides in the pronounced attenuation of model plasticity. To surmount these challenges, we propose Analytic Drift Resister (ADR), a novel and theoretically grounded NECGL framework. ADR exploits iterative backpropagation to break free from the frozen pre-trained constraint, adapting to evolving task graph distributions and fortifying model plasticity. Since parameter updates trigger feature drift, we further propose Hierarchical Analytic Merging (HAM), performing layer-wise merging of linear transformations in Graph Neural Networks (GNNs) via ridge regression, thereby ensuring absolute resistance to feature drift. On this basis, Analytic Classifier Reconstruction (ACR) enables theoretically zero-forgetting class-incremental learning. Empirical evaluation on four node classification benchmarks demonstrates that ADR maintains strong competitiveness against existing state-of-the-art methods.

持续学习图神经网络零遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。