arXiv:2509.24256cs.LGcs.AI2025-09

首个可统一求解图上距离优化问题的预训练模型,让图结构学习通用规律。

Graph Optimization Foundation Model: Tokenizing Graph via A Language-Model Paradigm

  • 用随机游走生成路径,模仿语言模型自监督预训练
  • 在20至893节点网络上表现媲美专用求解器,推理更快
  • 适合需要快速通用解法的图优化场景

预训练-迁移范式推动了大规模语言模型的成功,使其能从海量数据中学习通用表征。然而,将此范式扩展到图结构上的运筹学问题仍面临挑战,因语言的统计灵活性与图的严格组合约束存在根本冲突。为此,我们提出首个图基础模型(GFM),能够统一求解各类基于距离的图优化问题。通过在图的随机游走路径上引入类语言模型的自监督预训练,GFM被强制内化图的复杂拓扑与组合规则,将结构连通性本身作为监督信号。不同于现有神经方法学习复杂且任务特定的求解策略,本方法将预训练的GFM作为图的内在结构基础模型,从而支持简单生成启发式算法有效应对多样化的优化挑战。在20至893节点的多类网络上进行的全面实验表明,GFM在多种不同优化任务类别中表现媲美专用求解器,同时显著提升推理速度。本工作建立了预训练-迁移框架在图优化中的新范式,为将基础模型创新应用于运筹学开辟了道路。

原文摘要 · Abstract (English)

The pretrain-transfer paradigm, which underpins the success of large language models (LLMs), has demonstrated the immense power of creating foundation models that learn generalizable representations from vast datasets. However, extending this paradigm to Operations Research (OR) problems on graph structures remains challenging due to the fundamental conflict between the statistical flexibility of language and the strict combinatorial constraints of graphs. To bridge this gap, we introduce the Graph Foundation Model (GFM), the first framework capable of solving all distance-based optimization problems on graph structures. By introducing the LLM-like self-supervised pre-training paradigm on the paths generated from random walks in the graph, GFM is compelled to internalize the graph's complex topological and combinatorial rules, where the connectivity of the structure itself can be treated as the supervisory signal. Unlike existing neural methods that learn complex and task-specific solving policies, our approach leverages the pre-trained GFM as a foundational model of the graph's intrinsic structure, which in turn enables a simple generative heuristic to tackle a diverse range of optimization challenges effectively. Comprehensive experiments on networks ranging from 20 to 893 nodes demonstrate that GFM achieves competitive performance against specialized solvers across a variety of distinct optimization task classes, while maintaining significantly faster inference times. Our work establishes a new paradigm of adapting the pretrain-transfer framework to graph optimization, opening the door for applying foundation model innovations to OR.

图优化基础模型自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。