arXiv:2603.27169cs.AI2026-03被引 1

用大模型理解问题,图神经网络建模结构,联合求解组合优化。

Aligning LLMs with Graph Neural Solvers for Combinatorial Optimization

  • 大模型处理自然语言描述,图神经网络建模问题图结构。
  • 在多种组合优化任务上达到当前最佳性能,支持未见过的实例。
  • 适合需要跨问题泛化的组合优化研究者和应用开发者。

近期研究证明大语言模型(LLMs)可通过自然语言表示组合优化问题(COPs)并求解。然而,纯语言方法难以准确捕捉许多COP中复杂的关联结构,导致对中等及以上规模实例效果不佳。为此,我们提出AlignOPT,一种将LLMs与图神经求解器对齐的新方法,以学习更具泛化能力的神经型COP启发式算法。AlignOPT利用LLMs理解问题和实例的语义描述,同时通过图神经求解器显式建模实例的底层图结构。该方法实现了语言语义与结构表征的稳健融合,从而提升求解精度与可扩展性。实验表明,AlignOPT在多种COP任务上均达到当前最优表现,且展现出强大泛化能力,能有效处理此前未见的实例。

原文摘要 · Abstract (English)

Recent research has demonstrated the effectiveness of large language models (LLMs) in solving combinatorial optimization problems (COPs) by representing tasks and instances in natural language. However, purely language-based approaches struggle to accurately capture complex relational structures inherent in many COPs, rendering them less effective at addressing medium-sized or larger instances. To address these limitations, we propose AlignOPT, a novel approach that aligns LLMs with graph neural solvers to learn a more generalizable neural COP heuristic. Specifically, AlignOPT leverages the semantic understanding capabilities of LLMs to encode textual descriptions of COPs and their instances, while concurrently exploiting graph neural solvers to explicitly model the underlying graph structures of COP instances. Our approach facilitates a robust integration and alignment between linguistic semantics and structural representations, enabling more accurate and scalable COP solutions. Experimental results demonstrate that AlignOPT achieves state-of-the-art results across diverse COPs, underscoring its effectiveness in aligning semantic and structural representations. In particular, AlignOPT demonstrates strong generalization, effectively extending to previously unseen COP instances.

组合优化大模型图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。