不靠重放数据或预训练,用轻量模块动态调控图神经网络推理过程。
Task-Aware Adaptive Modulation: A Replay-Free and Resource-Efficient Approach For Continual Graph Learning
- 用任务感知的神经突触调制器动态调节冻结骨干网络的计算流
- 在6个基准数据集上超越现有最优方法,且无需存储历史数据
- 适合资源受限场景下的持续图学习,尤其关注高效与稳定兼顾
持续图学习(CGL)旨在获取新知识的同时保留已有信息,对真实世界图应用至关重要。现有方法面临两大挑战:1)稳定性-可塑性困境——依赖重放的数据方法常导致不平衡且存储开销大;2)资源密集型预训练——主流无重放方法严重依赖大规模预训练主干网络,带来巨大资源负担。本文认为,突破这些瓶颈的关键不在于重放数据或微调整个网络,而在于动态调制冻结主干网络的内部计算流程。我们提出任务感知自适应调制(TAAM),一种无重放、低资源消耗的方法,开辟了应对稳定性-可塑性困境的新路径。其核心是神经突触调制器(NSM),为每个任务训练后冻结以保存专家知识。通过原型引导策略:1)训练时,从相似历史调制器深拷贝初始化新NSM,提升知识迁移;2)推理时,为每项任务选择最相关冻结的NSM。这些NSM插入冻结的GNN主干中,实现细粒度、节点感知的内部流调控,区别于以往静态扰动。大量实验表明,TAAM在六个图持续学习基准数据集上全面超越当前最优方法。代码将在论文被接收后发布。
原文摘要 · Abstract (English)
Continual Graph Learning(CGL)focuses on acquiring new knowledge while retaining previously learned information, essential for real-world graph applications. Current methods grapple with two main issues:1) The Stability-Plasticity Dilemma: Replay-based methods often create an imbalance between the Dilemma, while incurring significant storage costs.2) The Resource-Heavy Pre-training: Leading replay-free methods critically depend on extensively pre-trained backbones, this reliance imposes a substantial resource burden.In this paper, we argue that the key to overcoming these challenges lies not in replaying data or fine-tuning the entire network, but in dynamically modulating the internal computational flow of a frozen backbone. We posit that lightweight, task-specific modules can effectively steer a GNN's reasoning process. Motivated by this insight, we propose Task-Aware Adaptive Modulation(TAAM), a replay-free, resource-efficient approach that charts a new path for navigating the stability-plasticity dilemma. TAAM's core is its Neural Synapse Modulators(NSM), which are trained and then frozen for each task to store expert knowledge. A pivotal prototype-guided strategy governs these modulators: 1) For training, it initializes a new NSM by deep-copying from a similar past modulator to boost knowledge transfer. 2) For inference, it selects the most relevant frozen NSM for each task. These NSMs insert into a frozen GNN backbone to perform fine-grained, node-attentive modulation of its internal flow-different from the static perturbations of prior methods. Extensive experiments show that TAAM comprehensively outperforms state-of-the-art methods across six GCIL benchmark datasets. The code will be released upon acceptance of the paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。