arXiv:2511.03739cs.CL2025-11被引 2

用大模型自验证文本推理过程,提升AI系统决策可靠性。

TextualVerifier: Verify TextGrad Step-by-Step

  • 通过思维链分解与多数投票机制,逐步验证文本推理
  • 在多个基准上使推理有效性提升29%,优化结果准确率提高2.2个百分点
  • 无需数值梯度,适合集成到文本优化系统中,适合追求高可靠性的研究者

TextGrad是一种基于文本的自动微分新方法,使复合AI系统可在无显式数值方程的情况下进行优化,但缺乏对文本决策过程的自我验证机制。本文提出TextualVerifier,一个基于大语言模型的验证框架,利用思维链推理与多数投票技术填补这一空白。该框架包含四个阶段:思维链分解、变体生成、多数投票与共识聚合,并非侵入式地集成至TextGrad的损失函数与优化结果验证阶段。实验采用Gemini 1.5 Pro模型,在两阶段评估中验证:(1)在PRM800K上独立测试,推理步骤有效性提升29%;(2)在GPQA-Diamond、MMLU-ML和MMLU-CP上与TextGrad集成,损失函数验证使准确率从68.2%提升至70.4%,平均仅增加5.9次LLM调用。版本对比显示,在GPQA、MMLU-ML和MMLU-CP上分别提升8.08、10.71和3.92个百分点。TextualVerifier首次实现无需数值梯度的TextGrad自验证,为基于文本的优化提供了更可靠的推理保障。

原文摘要 · Abstract (English)

TextGrad is a novel approach to text-based automatic differentiation that enables composite AI systems to perform optimization without explicit numerical equations. However, it currently lacks self-verification mechanisms that ensure reasoning validity in text-based decision making. This research introduces TextualVerifier, a verification framework that leverages chain-of-thought reasoning and majority voting with large language models to address this verification gap. TextualVerifier implements a four-stage workflow: chain-of-thought decomposition, variant generation, majority voting, and consensus aggregation. It integrates non-invasively with TextGrad at both the loss function and optimization result verification stages. Experimental evaluation using the Gemini 1.5 Pro model is conducted in two phases: (1) standalone evaluation on PRM800K, and (2) integrated evaluation with TextGrad on GPQA-Diamond, MMLU-ML, and MMLU-CP benchmarks. Results show statistically significant improvements (p < 0.001). In phase one, TextualVerifier improves the validity of reasoning steps by 29 percent. In phase two, integration into TextGrad loss function yields a 2.2 percentage point gain from 68.2 to 70.4 percent with a moderate overhead of 5.9 LLM calls on average. Further evaluations of TextualVerifier versioning yield 8.08, 10.71, and 3.92 percentage point improvements on GPQA, MMLU-ML, and MMLU-CP respectively. TextualVerifier thus presents the first self-verification framework for TextGrad through LLM-based techniques without requiring numerical gradients, enabling more reliable reasoning and opening new directions for verification in text-based optimization.

文本生成自验证LLM推理优化框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。