通过对抗循环优化,让大模型推理更稳定准确。
CAP-CoT: Cycle Adversarial Prompt for Improving Chain of Thoughts in LLM Reasoning

- 用正向求解器与对抗挑战者交替生成和纠错推理链
- 两到三轮迭代后,答案波动降低,准确率提升
- 适合需要高可靠推理的场景,如数学题、复杂决策
链式思维(CoT)提示已成为激发大语言模型逐步求解的有效方法。然而,在长而多步的问题上,CoT推理结果易出现运行间不一致。现有工作多关注单次推理链优化,较少涉及迭代式对比修正。为此,我们提出CAP-CoT:一种循环对抗提示优化框架,旨在提升单一部署求解器的推理准确率与稳定性。每轮循环中,正向求解器生成候选推理链,对抗挑战者基于特定错误策略构造看似合理但有缺陷的链,反馈代理对两者进行逐步对比并生成结构化反馈。该反馈同时更新求解器与挑战者提示,形成双向优化闭环。不同于安全导向的对抗提示(如越狱攻击),我们的对抗组件具有任务语义性,旨在暴露推理链中的逻辑漏洞。在六个基准与四种模型上的实验表明,仅需两到三轮优化,CAP-CoT即可显著降低运行间差异,提升推理准确率与对提示扰动的鲁棒性。
原文摘要 · Abstract (English)
Chain-of-Thought (CoT) prompting has emerged as a simple and effective way to elicit step-by-step solutions from large language models (LLMs). However, CoT reasoning can be unstable across runs on long, multi-step problems, leading to inconsistent answers for unchanged task. Most prior work focuses on improving the forward reasoning chain within a single pass, with less attention to iterative and contrastive correction. To address this gap, we propose CAP-CoT, a Cycle Adversarial Prompt optimization framework designed to improve both CoT reasoning accuracy and stability of a single deployed solver. In each cycle, a forward solver generates candidate reasoning chains, an adversarial challenger constructs plausible but deliberately flawed chains using targeted error strategies, and a feedback agent contrasts the two chains and produces step-aligned structured feedback. This feedback closes the optimization loop in two directions, including updating the solver prompt based on errors exposed by the challenger, and updating the challenger prompt to generate increasingly targeted errors in subsequent cycles. Unlike safety-oriented adversarial prompting such as jailbreak or prompt-injection attacks, our adversarial component is task-semantic and aims to expose logical vulnerabilities in reasoning chains. Experiments across six benchmarks and four LLM backbones demonstrate that within two to three adversarial prompt optimization cycles, CAP-CoT consistently reduces variability across runs while improving reasoning accuracy and robustness to prompt perturbations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。