arXiv:2607.10159cs.AI2026-07中稿 · ACM MM 2026

用大模型提升图学习的持续演化能力,解决语义与结构脱节问题。

UNIT: Unleash Large Language Models Potential for Graph Continual Learning

论文配图:UNIT: Unleash Large Language Models Potential for Graph Continual Learning
图 1 · 摘自论文原文
  • 仅在首任务微调大语言模型,缩小预训练语料与图数据分布差距。
  • 通过不确定感知锚点机制,保留跨任务通用知识,避免遗忘。
  • 显式融合拓扑结构与语义信息,增强模型对图结构的理解能力。

在真实多模态网络场景中,图结构数据常以流式方式持续到来,使图持续学习成为建模动态结构的关键范式。然而现有方法仍面临两大挑战:1)语义-结构分离,即基于图的方法擅长建模拓扑关系但忽视深层语义;2)知识迁移失衡,早期任务获得的通用知识难以有效迁移到后续新任务。为此,我们提出新型框架UNIT(UNleash Large Language Models Potential for Graph ConTinual Learning)。通过仅在首个任务上微调大语言模型,弥合预训练语料与目标数据集之间的分布差异,提升大模型对图任务的适应性。同时,提出不确定感知锚点生成机制,有效保留跨任务代表性知识,避免忽略早期学习到的通用知识。此外,引入结构融合建模,显式将图拓扑信息融入语义表示,增强语义理解与结构建模间的协同能力。大量实验表明,所提方法在图持续学习任务上达到当前最优性能。

原文摘要 · Abstract (English)

In real-world multimodal web scenarios, graph-structured data often arrives in a streaming manner, making graph continual learning a crucial paradigm for continuously modeling such evolving structures. However, existing graph continual learning methods still face two fundamental challenges. 1) semantic-structural separation, where the graph-based methods excel at modeling topological relationships but neglect deep semantics. 2) imbalanced knowledge transfer, where existing models fail to effectively leverage general knowledge gained from early tasks to benefit subsequent new tasks. To address above issues, we propose a novel framework, \textbf{UN}leash Large Language Models PotentIal for Graph ConTinual Learning (UNIT). By fine-tuning large language model only on the first task, we bridge the distributional gap between the pre-trained LLM corpus and the target task dataset to enhance the adaptability of LLMs for graph-structured tasks. Meanwhile, we propose an uncertain-aware anchor generation mechanism to effectively preserve representative knowledge across tasks, avoiding the neglect of universal knowledge learned from previous tasks. Additionally, we introduce structural confluence modeling to explicitly integrates graph topology information into semantic information, enhancing the collaborative capabilities between semantic understanding and structural modeling. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance in the graph continual learning task.

图学习大模型持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。