arXiv:2607.17641cs.AIcs.SE2026-07被引 2

解决大模型修复循环中真假有效性混淆的问题,让修复自动停止。

Verify, Repair, Repeat, or Stop? Robust Stopping for Noisy Verify-Repair Loops in LLM Agents

论文配图:Verify, Repair, Repeat, or Stop? Robust Stopping for Noisy Verify-Repair Loops in LLM Agents
图 1 · 摘自论文原文
  • 用四参数噪声模型分离验证器与修复器的错误行为
  • 通过投票信念过滤估计真实有效性,按边际收益正负决定是否继续修复
  • 在噪声大时仍可靠,适合高容错场景的智能体系统

验证-修复循环是大语言模型智能体在代码生成、数学推理和工具使用中修正错误计划的标准方法。当验证器和修复器均存在噪声时,修复可能破坏本已正确的计划,导致报告接受率上升而真实有效性下降,现有方法缺乏合理的停止依据。本文提出VRR-Stop,一种针对噪声验证-修复-重复循环的鲁棒停止框架。通过四参数噪声模型分离验证器误接受与误拒绝,以及修复器的修复与破坏行为。信念过滤将多次验证投票转化为对已承诺有效性的估计,根据真实边际收益符号决定是否继续修复,仅需符号可识别,无需精确恢复所有参数。当验证器判别力趋近零时,校准失效,估计误差可能导致停止信号反转,因此搭配VRR-Guard——一种无估计的备用机制,在验证置信度足够高时才替换当前候选。在GSM8K压力设置下,相比固定五轮修复,VRR-Stop将最终真实有效性提升60.6个百分点,平均仅需0.72轮修复。跨不同设置,停止可靠性由验证器判别力与决策裕度共同决定,而非估计误差的绝对大小。

原文摘要 · Abstract (English)

Verify-repair loops are a standard means for large language model (LLM) agents to correct faulty plans in code generation, mathematical reasoning, and tool use. When both the verifier and the repairer are noisy, repair can damage already-correct plans, and reported acceptance keeps rising while true validity falls, so existing methods lack a principled basis for deciding when repair should stop. We propose VRR-Stop, a robust stopping framework for noisy verify-repair-repeat (VRR) loops. A four-parameter noise model separates verifier false acceptance and false rejection from the repair and damage behavior of the repairer. Belief filtering turns repeated verification votes into an estimate of committed validity, and the loop commits or repairs according to the sign of the true marginal gain, which requires only sign identifiability rather than accurate recovery of all parameters. When verifier discrimination approaches zero, calibration itself fails and estimation error can flip the stopping sign, so we pair VRR-Stop with VRR-Guard, an estimation-free fallback that replaces the incumbent candidate only under a sufficient verification margin. On a GSM8K stress setting, VRR-Stop improves final true validity by 60.6 percentage points over fixed five-round repair at an average cost of 0.72 repair rounds. Across settings, stopping reliability is governed jointly by verifier discrimination and the decision margin rather than by the absolute size of estimation error.

大模型智能体验证修复鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。