用图结构引导大模型深度搜索,解决长期推理中的状态丢失问题。
G-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolution

- 以固定拓扑的查询图组织推理过程,显式跟踪搜索状态
- 仅用1.9K条轨迹微调,中文浏览评测达52.6%准确率
- 适用于训练与推理,可提升现有大模型深搜能力
深度搜索已成为大语言模型解决开放域复杂任务的核心能力。然而,现有方法多依赖线性序列推理,在长程多跳搜索中难以持续保持中间状态与约束,导致上下文遗忘、搜索漂移和探索效率低。为此,我们提出G-ReAct,一种基于图结构的状态-结构协同演化的推理框架。该框架将推理过程建模为固定拓扑查询图上的状态演化,显式追踪搜索进展并指导后续决策,将依赖文本历史的探索式搜索转化为受显式约束的图引导推理。G-ReAct支持训练与推理:生成高质量深搜轨迹用于监督微调,并在推理时提供结构化引导,无需额外微调。实验表明,仅用1.9K条生成轨迹微调后,Qwen3-30B-A3B-Thinking-2507在BrowseComp-ZH上达到52.6%准确率,在XBench上达79.0%,优于使用更大数据集(包括强化学习增强方法)训练的同类开源模型。此外,在推理阶段应用G-ReAct,可持续提升现有强模型在深搜任务上的表现。代码与模型权重将公开发布。
原文摘要 · Abstract (English)
Deep search has become a fundamental capability of large language models (LLMs) for solving open-domain complex tasks. However, existing approaches typically rely on linear sequential reasoning for both trajectory generation and inference, making it difficult to consistently preserve intermediate states and constraints throughout long-horizon multi-hop search. Consequently, they often suffer from context forgetting, search drift, and inefficient exploration. To address these limitations, we propose $\textbf{G-ReAct}$, a reasoning framework for deep search that organizes reasoning as $\textbf{state evolution over a fixed-topology query graph}$. The evolving graph state explicitly tracks search progress and guides subsequent decisions, transforming exploratory search driven by textual history into graph-guided reasoning under explicit constraints. G-ReAct supports both training and inference: it generates high-quality deep-search trajectories for supervised fine-tuning and provides structured guidance for inference-time search without additional fine-tuning. Experiments demonstrate that with only 1.9K generated trajectories for fine-tuning, Qwen3-30B-A3B-Thinking-2507 achieves $52.6\%$ accuracy on BrowseComp-ZH and $79.0\%$ on XBench, outperforming comparable open-source methods trained on substantially larger datasets, including RL-enhanced methods. Furthermore, when applied at inference time, G-ReAct consistently improves the performance of existing strong LLMs on deep-search tasks. We will publicly release all code and model weights.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。