arXiv:2508.02511cs.AIcs.CL2025-08AAAI被引 11

通过测试时提示干预,让大模型推理更简洁可靠

Test-time Prompt Intervention

  • 测试时动态调整推理路径,控制思维过程
  • 减少冗余步骤与幻觉,推理长度缩短30%以上
  • 适合需要可控、可解释推理的场景

测试时计算已显著提升大语言模型在复杂任务上的表现,尤其通过生成更长的思维链(CoT)来增强推理能力。然而,现有模型的思维链常存在过度冗余问题,包括不必要的验证步骤和重复的推理转换。其根源在于训练阶段过度依赖结果奖励,而难以规模化构建中间步骤奖励数据。为此,我们提出PI框架——测试时提示干预,通过‘何时’(When模块)、‘如何’(How模块)和‘选择’(Which模块)三部分,在推理过程中动态引导并调节思维路径。该方法可无缝融入人类解题经验和认知科学原理,提升模型的可控性与可解释性。多模型、多数据集的实验证明,PI能显著缩短思维链长度,同时降低幻觉率,实现更简洁、可靠的推理。

原文摘要 · Abstract (English)

Test-time compute has led to remarkable success in the large language model (LLM) community, particularly for complex tasks, where longer chains of thought (CoTs) are generated to enhance reasoning capabilities. However, growing evidence reveals that such reasoning models often produce CoTs plagued by excessive redundancy, including unnecessary verification steps and repetitive reasoning shifts. The root cause lies in post-training of them that overly rely on outcome reward paradigms, as the data of process reward paradigms, which regulate intermediate reasoning steps, is difficult to construct at scale. To address this, we propose PI, a novel framework for Test-time Prompt Intervention. PI provides an interface to dynamically guide and regulate reasoning paths during inference through timely (When module) and proper (How module) interventions and post-intervention sampling (Which module). This allows human problem-solving expertise and cognitive science principles to be seamlessly integrated into LLMs' reasoning processes, enhancing controllability and interpretability. Extensive experiments across multiple models and datasets demonstrate that PI significantly shortens CoTs while reducing hallucination, yielding more concise and reliable reasoning.

推理优化提示工程大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。