通过迭代验证循环,让大模型自动纠错且不破坏正确答案。
Denoising Iterative Self-Correction: Structured Verification Loops for Reliable LLM Reasoning
- 用噪声检测思想逐轮修复推理错误,避免误改正确结果。
- 在三个基准上准确率达81.6%,纠错效率比现有方法高5至13倍。
- 适合需要高可靠推理的场景,如复杂问答与决策系统。
大型语言模型虽能生成流畅的多步推理,但常出错;直接修正可能破坏本已正确的答案。本文提出去噪迭代自校正(DISC),一种测试时的纠错机制,将验证输出视为潜在错误位置的噪声信号。通过多轮验证-判断-修正循环,逐步减少错误。一个二值判断门控机制防止对正确答案的误改,而验证器与修正器协同修复错误。我们使用两个诊断指标评估:改进与退化比率(精度)和修复率(召回)。在三个基准(BIG-Bench Mistake、HotpotQA、GPQA Diamond)和四个模型上,DISC 在精度-召回权衡上优于 Chain-of-Verification 与 Self-Refine,于 BIG-Bench Mistake(Sonnet 4.5)上达 81.6% 准确率,每出现一次退化,可产生 13 倍于 Chain-of-Verification 的改进和 5 倍于 Self-Refine。在 GPQA Diamond 上发现存在能力天花板,模型能识别证据矛盾却无法转化为修正。此外,跨模型角色分配(验证/判断由不同于生成器的模型完成)可缓解自我确认偏差。
原文摘要 · Abstract (English)
Large language models produce fluent but often incorrect multi-step reasoning, and naive correction methods risk degrading already-correct answers. We introduce Denoising Iterative Self-Correction (DISC), a test-time procedure that treats verification question outputs as noisy measurements of where a solution may be corrupted. Using these signals, DISC progressively reduces errors across multiple verify-judge-correct passes, analogous to traditional iterative denoising. A binary judgment gate controls correction precision by blocking rewrites that would damage already-correct answers while the verifier and corrector together repair errors. We evaluate this trade-off using two paired diagnostics: an improvement-to-degradation ratio (precision) and a repair rate (recall). Across three benchmarks (BIG-Bench Mistake, HotpotQA, GPQA Diamond) and four models, DISC dominates Chain-of-Verification and Self-Refine on the precision-recall trade-off, reaching 81.6% accuracy with 13x more improvements per degradation than Chain-of-Verification and 5x more than Self-Refine on BIG-Bench Mistake (Sonnet~4.5). On GPQA Diamond, we identify a capability floor below which judges acknowledge contradictions in evidence but cannot translate that recognition into a correction. We further show that cross-model role allocation -- assigning verification and judgment to a model different from the generator -- mitigates self-confirmation bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。