让大模型推理路径相互评审,用一次修订提升逻辑准确性。
A Single Revision Step Improves Token-Efficient LLM Reasoning
- 推理路径通过共识包互相审查,定位逻辑分歧点
- 在AIME和BRUMO上达到256样本投票的准确率
- 无需训练,适合提升现有推理系统的可靠性
大语言模型在复杂推理任务中通过增加测试时计算量、采样多条推理路径来提高准确率。但传统聚合方法如多数投票或置信度过滤存在根本缺陷:孤立评估每条路径。随着问题难度上升,模型常生成看似可信却含幻觉的推理路径,导致正确答案被边缘化。本文提出PACER框架,一种无需训练、仅在推理阶段使用的结构化协同修正机制。在初步筛选后,构建包含唯一候选答案、聚合置信度及代表性推理摘要的紧凑共识包;各路径据此进行针对性自审,识别与整体共识的分歧点并修正错误推理。最终采用加权投票得出结论。在AIME和BRUMO等高难度数学竞赛数据集上,PACER达到甚至超过256样本多数投票的性能,显著优于原始集成基线,将简单共识升级为协作式逻辑精炼过程。
原文摘要 · Abstract (English)
Large language models (LLMs) achieve higher accuracy on challenging reasoning tasks by scaling test-time compute through multiple trajectory sampling. However, standard aggregation methods like majority voting or individual confidence-based filtering face a fundamental "blind spot": they evaluate each trace in isolation. As problems scale in difficulty, models often generate hallucinated paths that exhibit misleadingly high confidence, causing the true solution to be suppressed by a narrow margin in traditional voting. We ask: can we enable traces to "peer-review" each other to resolve these near-miss errors? We introduce Packet-Conditioned Revision (PACER), a training-free, inference-only framework that enables reasoning traces to revise their conclusions through a structured coordination step. After a preliminary screening of generated traces, PACER constructs a compact consensus packet containing (i) unique candidate answers, (ii) their aggregated confidence scores, and (iii) representative reasoning summaries for each candidate answer. Individual traces then perform a targeted self-review conditioned on this packet, allowing them to identify specific logical junctions where they diverged from the broader consensus and pivot if their original reasoning is found to be flawed. Final predictions are obtained via confidence-weighted voting over these revised trajectories. On challenging competitive math benchmarks such as AIME and BRUMO, PACER matches or exceeds the accuracy of 256-sample majority voting, significantly outperforming raw ensemble baselines by transforming simple consensus into a collaborative logical refinement process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。