arXiv:2603.14730cs.LG2026-03

用图神经网络验证大模型任务规划,提升准确性与可靠性。

GNNVerifier: Graph-based Verifier for LLM Task Planning

  • 将任务规划转为带属性的有向图,显式建模步骤间依赖关系。
  • 图级可信度评分与节点/边级风险评分联合判断计划优劣。
  • 可自动构建带细粒度标注的训练数据,适合改进规划器性能。

大型语言模型(LLMs)推动了自主智能体的发展。任务规划作为其核心组件,旨在将复杂的自然语言请求分解为可执行的子任务。然而,LLM生成的计划常存在幻觉问题,且对长上下文提示敏感。现有方法多依赖额外提示或自我反思的LLM作为验证器,易被合理叙述误导,难以识别跨步骤的结构性错误,如类型不匹配、中间缺失或依赖断裂。为此,本文提出一种基于图结构的验证器GNNVerifier。首先,将计划表示为带丰富属性的有向图,节点代表子任务,边编码执行顺序与依赖约束;其次,使用图神经网络(GNN)进行结构评估与诊断,输出图级合理性分数以决定计划接受与否,并生成节点/边级风险分数定位错误区域;第三,基于真实计划图构造可控扰动,自动生成带细粒度标注的训练数据;最后,在GNN验证器反馈指导下,引导LLM进行局部修正(如工具替换或插入),以提升计划质量。在多个数据集、骨干模型和规划器上的实验表明,GNNVerifier显著提升了计划质量。代码与数据已开源:https://github.com/BUPT-GAMMA/GNNVerifier。

原文摘要 · Abstract (English)

Large language models (LLMs) facilitate the development of autonomous agents. As a core component of such agents, task planning aims to decompose complex natural language requests into concrete, solvable sub-tasks. Since LLM-generated plans are frequently prone to hallucinations and sensitive to long-context prom-pts, recent research has introduced plan verifiers to identify and correct potential flaws. However, most existing approaches still rely on an LLM as the verifier via additional prompting for plan review or self-reflection. LLM-based verifiers can be misled by plausible narration and struggle to detect failures caused by structural relations across steps, such as type mismatches, missing intermediates, or broken dependencies. To address these limitations, we propose a graph-based verifier for LLM task planning. Specifically, the proposed method has four major components: Firstly, we represent a plan as a directed graph with enriched attributes, where nodes denote sub-tasks and edges encode execution order and dependency constraints. Secondly, a graph neural network (GNN) then performs structural evaluation and diagnosis, producing a graph-level plausibility score for plan acceptance as well as node/edge-level risk scores to localize erroneous regions. Thirdly, we construct controllable perturbations from ground truth plan graphs, and automatically generate training data with fine-grained annotations. Finally, guided by the feedback from our GNN verifier, we enable an LLM to conduct local edits (e.g., tool replacement or insertion) to correct the plan when the graph-level score is insufficient. Extensive experiments across diverse datasets, backbone LLMs, and planners demonstrate that our GNNVerifier achieves significant gains in improving plan quality. Our data and code is available at https://github.com/BUPT-GAMMA/GNNVerifier.

大模型任务规划图神经网络验证器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。