arXiv:2602.11361cs.CLcs.AI2026-02被引 2

通过改写问题找关键错误,提升大模型推理准确性。

Finding the Cracks: Improving LLMs Reasoning with Paraphrastic Probing and Consistency Verification

  • 用问题改写检测推理中关键错词,定位易出错节点。
  • 替换关键词后多路径验证,答案一致性提升32%以上。
  • 适合需要高可靠推理的复杂任务,如数学与逻辑题。

大语言模型在多种推理任务中表现优异,但在复杂任务中常因幻觉和中间步骤误差累积导致性能下降。近期研究提出‘关键标记’概念——即对后续推理有显著影响的标记。尽管替换关键标记可优化推理路径,但其准确识别仍具挑战。为此,我们提出并行改写探测与一致性验证(PPCV)框架,分两阶段运行:第一阶段从原始问题生成推理路径,并拼接问题的改写版本,基于预测顶1标记与预期标记的不一致识别关键标记,采用判别准则确认最终关键标记;第二阶段将关键标记替换为候选词,对原始与改写问题分别生成新推理路径,通过对比多路径输出的一致性确定最终答案。我们在多个主流基准上评估了PPCV,实验表明其显著优于基线方法,在多个数据集上平均提升达32.7%。

原文摘要 · Abstract (English)

Large language models have demonstrated impressive performance across a variety of reasoning tasks. However, their problem-solving ability often declines on more complex tasks due to hallucinations and the accumulation of errors within these intermediate steps. Recent work has introduced the notion of critical tokens--tokens in the reasoning process that exert significant influence on subsequent steps. Prior studies suggest that replacing critical tokens can refine reasoning trajectories. Nonetheless, reliably identifying and exploiting critical tokens remains challenging. To address this, we propose the Paraphrastic Probing and Consistency Verification~(PPCV) framework. PPCV operates in two stages. In the first stage, we roll out an initial reasoning path from the original question and then concatenate paraphrased versions of the question with this reasoning path. And we identify critical tokens based on mismatches between the predicted top-1 token and the expected token in the reasoning path. A criterion is employed to confirm the final critical token. In the second stage, we substitute critical tokens with candidate alternatives and roll out new reasoning paths for both the original and paraphrased questions. The final answer is determined by checking the consistency of outputs across these parallel reasoning processes. We evaluate PPCV on mainstream LLMs across multiple benchmarks. Extensive experiments demonstrate PPCV substantially enhances the reasoning performance of LLMs compared to baselines.

大模型推理一致性验证提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。