arXiv:2508.04645cs.LGcs.AI2025-08KDD被引 5

提出高效可扩展的图链接预测预训练框架,实现低资源下性能突破。

A Scalable Pretraining Framework for Link Prediction with Efficient Adaptation

  • 设计晚期融合机制,整合节点与边信息提升预测能力。
  • 在16个数据集上达成领先性能,计算开销降低超1万倍。
  • 适合需快速适配新数据集的工业级图学习场景。

链接预测(LP)是图机器学习中的关键任务。尽管图神经网络(GNN)近年显著提升了LP性能,现有方法仍面临稀疏连接导致监督不足、对初始化敏感以及分布偏移下泛化能力差等挑战。本文探索预训练作为解决方案。不同于节点分类,LP本质上是成对任务,需融合节点与边级信息。本工作首次系统研究此类模块的可迁移性,提出晚期融合策略有效结合两者输出以提升性能。为应对预训练数据多样性并避免负迁移,引入多专家(MoE)框架,让各专家捕捉不同模式,实现预训练模型在多样化下游数据集上的无缝应用。为实现快速适应,开发参数高效调优策略,使预训练模型可在极低计算开销下适配未见数据集。在两个领域共16个数据集上的实验表明,该方法在低资源链接预测中达到当前最优性能,且与端到端训练方法相比保持竞争力,计算开销降低超过10,000倍。

原文摘要 · Abstract (English)

Link Prediction (LP) is a critical task in graph machine learning. While Graph Neural Networks (GNNs) have significantly advanced LP performance recently, existing methods face key challenges including limited supervision from sparse connectivity, sensitivity to initialization, and poor generalization under distribution shifts. We explore pretraining as a solution to address these challenges. Unlike node classification, LP is inherently a pairwise task, which requires the integration of both node- and edge-level information. In this work, we present the first systematic study on the transferability of these distinct modules and propose a late fusion strategy to effectively combine their outputs for improved performance. To handle the diversity of pretraining data and avoid negative transfer, we introduce a Mixture-of-Experts (MoE) framework that captures distinct patterns in separate experts, facilitating seamless application of the pretrained model on diverse downstream datasets. For fast adaptation, we develop a parameter-efficient tuning strategy that allows the pretrained model to adapt to unseen datasets with minimal computational overhead. Experiments on 16 datasets across two domains demonstrate the effectiveness of our approach, achieving state-of-the-art performance on low-resource link prediction while obtaining competitive results compared to end-to-end trained methods, with over 10,000x lower computational overhead.

链接预测预训练图神经网络高效适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。