arXiv:2601.15124cs.LGcs.AI2026-01中稿 · the Web Conference…被引 4

用检索增强生成解决图模型知识存储瓶颈问题

RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation

  • 将图知识外置到双模态检索库,分离参数与知识
  • 在5个数据集上超越13个基线模型,提升分类效果
  • 适合需要高效适配和可解释性的图学习研究者

图基础模型(GFMs)在图学习领域崭露头角,有望实现跨任务的可迁移表征。然而,现有模型受限于内存瓶颈:将知识编码进参数中,导致语义容量受限、压缩失真严重且存在冲突,同时使图表示与知识纠缠,阻碍高效适应,损害可扩展性与可解释性。本文提出RAG-GFM,一种基于检索增强生成的图基础模型,通过将知识从参数中卸载并补充参数化学习。为外部化图知识,构建了双模态统一检索模块,其中语义库基于前缀结构文本,结构库基于中心性关键模式。为保留异构信息,设计双视图对齐目标,对比两种模态以捕捉内容与关系模式。为支持下游高效适配,采用上下文增强策略,利用检索到的文本与模式作为上下文证据扩充支持实例。在五个基准图数据集上的实验表明,RAG-GFM在跨域节点与图分类任务中持续优于13个先进基线,展现出卓越的有效性与效率。

原文摘要 · Abstract (English)

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode knowledge into model parameters, which limits semantic capacity, introduces heavy lossy compression with conflicts, and entangles graph representation with the knowledge in ways that hinder efficient adaptation, undermining scalability and interpretability. In this work,we propose RAG-GFM, a Retrieval-Augmented Generation aided Graph Foundation Model that offloads knowledge from parameters and complements parameterized learning. To externalize graph knowledge, we build a dual-modal unified retrieval module, where a semantic store from prefix-structured text and a structural store from centrality-based motif. To preserve heterogeneous information, we design a dual-view alignment objective that contrasts both modalities to capture both content and relational patterns. To enable efficient downstream adaptation, we perform in-context augmentation to enrich supporting instances with retrieved texts and motifs as contextual evidence. Extensive experiments on five benchmark graph datasets demonstrate that RAG-GFM consistently outperforms 13 state-of-the-art baselines in both cross-domain node and graph classification, achieving superior effectiveness and efficiency.

图神经网络检索增强知识外置

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。