提出可验证的推理图框架,让大模型分析数据时每步结论都有据可查。
VeriGraph: Towards Verifiable Data-Analytic Agents

- 用异构证据有向无环图显式记录推理过程,连接原始数据与结论
- 在4个基准上达最优表现,结论支撑率高达87.61%
- 适合需要可审计、可复现的数据分析场景
基于大语言模型的智能体在数据密集型分析任务中表现出色,但其输出难以验证:线性文本流导致推理过程难以审计。原始数据的确定性计算与自然语言判断的语义推导常混杂于无结构的文本流中,使数值结论难复现、定性判断难检验。为此,我们提出VeriGraph,一种可追溯的神经符号推理框架,使智能体在执行过程中构建显式的异构证据有向无环图(DAG)。VeriGraph引入三种证据扩展原语——计算扩展、对齐扩展和推导扩展,将原始数据、解释器变量、计算结果与自然语言陈述统一关联。在此框架下,结构可追溯性转化为从原始数据源到终态主张的图可达性,语义支持度通过主张级证据评估衡量。为优化图构建,我们设计基于图的策略优化方法,采用复合奖励联合监督答案正确性、计算完整性与推导一致性。在四个基准测试中,VeriGraph-8B取得所有基线中的最高综合得分。更重要的是,VeriGraph生成的可审计证据图在主张对齐方面显著增强,在主张级证据支持评估中达到87.61%的对齐率。结果表明,显式证据图构建是实现可验证数据分析智能体的可行路径。代码已开源:https://github.com/ignorejjj/VeriGraph。
原文摘要 · Abstract (English)
LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit. In particular, deterministic computations over raw data and semantic deductions over natural-language claims are often entangled in an unstructured stream, leaving numerical conclusions hard to reproduce and qualitative judgments hard to inspect. To address this, we propose VeriGraph, a traceable neuro-symbolic reasoning framework that enables agents to construct an explicit heterogeneous evidence directed acyclic graph (DAG) during execution. VeriGraph introduces three evidence-expansion primitives, namely computational, grounding, and derivational expansion, to connect raw data, interpreter variables, computed results, and natural-language claims in a unified graph. Under this formulation, structural traceability is reduced to graph reachability from raw data sources to terminal claims, while semantic support is measured by claim-level evidence evaluation. To improve graph construction, we further design a graph-based policy optimization strategy with a composite reward that jointly supervises answer correctness, computational integrity, and derivational coherence. Experiments on four benchmarks show that VeriGraph-8B achieves the highest overall score among all baselines. More importantly, VeriGraph produces auditable evidence graphs with substantially stronger claim grounding, achieving a 87.61\% Grounding Rate under our claim-level evidence support evaluation. These results suggest that explicit evidence-graph construction is a promising path toward verifiable data-analytic agents. Our code is available at https://github.com/ignorejjj/VeriGraph.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。