arXiv:2508.20906cs.LG2025-08被引 26

用表格模型做图学习,让通用模型轻松处理不同特征的图数据。

Turning Tabular Foundation Models into Graph Foundation Models

  • 把节点特征与邻域聚合结合,构造新表示后输入表格模型
  • 少样本下表现超越现有图模型和训练良好的GNN
  • 适合希望快速部署、不擅长调参的研究者使用

尽管基础模型已革新自然语言处理和计算机视觉领域,但在图机器学习中的潜力仍待挖掘。设计图基础模型(GFMs)的关键挑战在于处理跨数据集差异显著的节点特征。现有工作多聚焦于文本属性图,而对其他类型特征的处理尚未充分解决。这一问题在表格数据机器学习中同样存在。受近期表格基础模型(如TabPFNv2和LimiX)成功的启发,本文提出G2T-FM框架,使表格基础模型可用于图节点级任务。该方法通过邻域特征聚合扩展原始节点特征,并加入结构嵌入,再将构建的节点表示输入表格模型。即使在上下文学习设置下,结合强表格模型时,其性能也优于已有图模型和从头训练的优秀GNN。微调后,G2T-FM持续超越经过精细调优的GNN基线,差距显著。本研究揭示了利用表格基础模型开展图学习这一被忽视方向的巨大潜力。

原文摘要 · Abstract (English)

While foundation models have revolutionized fields such as natural language processing and computer vision, their potential in graph machine learning remains largely unexplored. One of the key challenges in designing graph foundation models (GFMs) is handling diverse node features that can vary across different graph datasets. While many works on GFMs have focused exclusively on text-attributed graphs, the problem of handling arbitrary features of other types in GFMs has not been fully addressed. However, this problem is not unique to the graph domain, as it also arises in the field of machine learning for tabular data. In this work, motivated by the recent success of tabular foundation models (TFMs) like TabPFNv2 and LimiX, we propose G2T-FM, a simple framework that allows tabular foundation models to be applied to graph node-level tasks. Specifically, G2T-FM augments the original node features with neighborhood feature aggregation, adds structural embeddings, and then applies a TFM to the constructed node representations. Even in the in-context learning setting, our model achieves strong results when combined with a strong TFM, outperforming both prior GFMs and well-tuned GNNs trained from scratch. Moreover, after finetuning, G2T-FM consistently surpasses well-tuned GNN baselines, often by a significant margin. In summary, our paper reveals the potential of a previously overlooked direction: utilizing tabular foundation models for graph machine learning tasks.

图学习基础模型表格模型少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。