arXiv:2512.17912cs.CLcs.AI2025-12被引 6

用强化学习+蒙特卡洛搜索,让大模型更智能地推理带文本的图结构数据。

Graph-O1 : Monte Carlo Tree Search with Reinforcement Learning for Text-Attributed Graph Reasoning

  • 结合MCTS与强化学习,让模型分步选择性探索图中关键信息。
  • 在多个数据集上准确率超越现有方法,答案更可靠可解释。
  • 适合需要深度图推理的科研或工业场景,如知识图谱问答。

文本属性图(text-attributed graphs)在多个领域广泛应用,其节点和边包含丰富的文本信息。核心挑战是问答任务,需同时利用非结构化文本与图的结构关系信号。尽管大语言模型(LLMs)在自然语言理解上取得进展,但直接用于文本属性图推理仍受限。纯文本检索增强生成方法常将段落视为孤立单元,忽略图的连接结构;而图基RAG方法将大型子图序列化为长文本,易受LLM上下文长度限制,导致推理碎片化、准确率下降。为此,我们提出Graph-O1,一种基于代理的GraphRAG框架,使LLM能对图进行分步交互式推理。该方法融合蒙特卡洛树搜索(MCTS)与端到端强化学习,引导模型选择性探索最相关子图组件。推理过程被建模为代理与图环境的多轮互动,通过统一奖励机制训练代理。在多个LLM主干上的大量实验表明,Graph-O1持续优于现有最优基准,在准确性、可靠性与可解释性方面均有提升。

原文摘要 · Abstract (English)

ChatGPT said: Text-attributed graphs, where nodes and edges contain rich textual information, are widely used across diverse domains. A central challenge in this setting is question answering, which requires jointly leveraging unstructured text and the structured relational signals within the graph. Although Large Language Models (LLMs) have made significant advances in natural language understanding, their direct use for reasoning over text-attributed graphs remains limited. Retrieval-augmented generation methods that operate purely on text often treat passages as isolated units, ignoring the interconnected structure of the graph. Conversely, graph-based RAG methods that serialize large subgraphs into long textual sequences quickly become infeasible due to LLM context-length constraints, resulting in fragmented reasoning and degraded accuracy. To overcome these limitations, we introduce Graph-O1, an agentic GraphRAG framework that enables LLMs to conduct stepwise, interactive reasoning over graphs. Our approach integrates Monte Carlo Tree Search (MCTS) with end-to-end reinforcement learning, allowing the model to selectively explore and retrieve only the most informative subgraph components. The reasoning procedure is framed as a multi-turn interaction between the agent and the graph environment, and the agent is trained through a unified reward mechanism. Extensive experiments across multiple LLM backbones demonstrate that Graph-O1 consistently surpasses state-of-the-art baselines, producing answers that are more accurate, reliable, and interpretable.

图神经网络强化学习大模型推理文本图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。