arXiv:2410.23855cs.LGcs.AI2024-10NeurIPS被引 40

用外部图数据增强GNN,让模型更好应对新场景。

RAGraph: A General Retrieval-Augmented Graph Learning Framework

  • 构建图向量库,通过相似性检索外部图数据。
  • 在节点分类等任务中显著优于现有方法,无需微调。
  • 适合需要强泛化能力的图学习应用。

图神经网络(GNN)在多个领域用于解释关系数据,但往往难以泛化到与训练数据差异较大的新图上。本文提出通用检索增强图学习框架RAGraph,通过引入外部图数据提升模型在未知场景下的泛化能力。该框架基于自建的玩具图向量库,存储特征与任务相关标签信息;推理时根据下游任务中的关键相似性,检索相似的玩具图,并通过消息传递提示机制融合检索数据,丰富学习上下文。大量实验表明,RAGraph在节点分类、链接预测和图分类等多项任务中均显著优于当前最先进方法,涵盖动态与静态数据集。此外,测试验证其无需任务特定微调即可保持高性能,展现出良好的适应性、鲁棒性和广泛适用性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have become essential in interpreting relational data across various domains, yet, they often struggle to generalize to unseen graph data that differs markedly from training instances. In this paper, we introduce a novel framework called General Retrieval-Augmented Graph Learning (RAGraph), which brings external graph data into the general graph foundation model to improve model generalization on unseen scenarios. On the top of our framework is a toy graph vector library that we established, which captures key attributes, such as features and task-specific label information. During inference, the RAGraph adeptly retrieves similar toy graphs based on key similarities in downstream tasks, integrating the retrieved data to enrich the learning context via the message-passing prompting mechanism. Our extensive experimental evaluations demonstrate that RAGraph significantly outperforms state-of-the-art graph learning methods in multiple tasks such as node classification, link prediction, and graph classification across both dynamic and static datasets. Furthermore, extensive testing confirms that RAGraph consistently maintains high performance without the need for task-specific fine-tuning, highlighting its adaptability, robustness, and broad applicability.

图神经网络检索增强泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。