arXiv:2605.04834cs.LG2026-05被引 4

让图模型无视输入特征差异,跨数据集通用。

Bridging Input Feature Spaces Towards Graph Foundation Models

论文配图:Bridging Input Feature Spaces Towards Graph Foundation Models
图 1 · 摘自论文原文
  • 将节点特征投影到共享随机空间,用协方差统计构建表示
  • 在新数据集上无需重训即达强性能,支持节点与图级别任务
  • 对特征排列和正交变换均保持分布不变性,适合跨域迁移

与视觉和语言领域不同,图学习缺乏统一的输入空间,因不同图数据集的输入特征不仅语义各异,且取值范围和维度也不同。这种不一致阻碍了图模型在数据集间的泛化,限制其作为基础模型的应用。本文提出ALL-IN,一种简单且理论严谨的方法,实现不同输入特征数据集间的可迁移性。该方法将节点特征投影至共享随机空间,并基于协方差统计构建表示,从而消除对原始特征空间的依赖。我们证明,计算出的节点协方差算子及其生成的节点表示,在输入特征排列下具有分布不变性;进一步表明,期望算子对输入特征的任意正交变换也保持不变。实验显示,ALL-IN在未见数据集上,面对新输入特征时,无需架构调整或重训练,即可在多种节点级和图级任务中表现优异。结果表明,迈向无输入依赖、可迁移的图基础模型具备可行性。

原文摘要 · Abstract (English)

Unlike vision and language domains, graph learning lacks a shared input space, as input features differ across graph datasets not only in semantics, but also in value ranges and dimensionality. This misalignment prevents graph models from generalizing across datasets, limiting their use as foundation models. In this work, we propose ALL-IN, a simple and theoretically grounded method that enables transferability across datasets with different input features. Our approach projects node features into a shared random space and constructs representations via covariance-based statistics, thus eliminating dependence on the original feature space. We show that the computed node-covariance operators and the resulting node representations are invariant in distribution to permutations of the input features. We further demonstrate that the expected operator exhibits invariance to general orthogonal transformations of the input features. Empirically, ALL-IN achieves strong performance across diverse node- and graph-level tasks on unseen datasets with new input features, without requiring architecture changes or retraining. These results point to a promising direction for input-agnostic, transferable graph models.

图神经网络跨数据集迁移特征对齐基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。