让大模型在做决定前自我审查推理,避免错误信念传播。
Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
- 构建基于角色的多样化候选信念,筛选更可信的内部认知
- 通过对抗性审计定位逻辑漏洞,用最小干预修复错误
- 在6个数据集上显著提升推理可靠性,不影响任务表现
在大型语言模型(LLM)代理中,推理路径常被视为指导行为和更新记忆的可靠内部信念。然而,连贯的推理仍可能违反逻辑或证据约束,导致未经证实的信念在多个决策步骤中反复存储与传播,引发长周期代理系统的系统性行为漂移。现有策略多依赖共识机制,将一致性误认为可靠性。本文受不忠实中间推理路径的启发,提出自审计验证推理框架(SAVeR),在代理执行动作前对内部信念状态进行验证,实现可靠推理。具体地,我们结构化生成基于角色的多样化候选信念,在与可信度相关的结构空间中选择;为确保推理可靠性,通过对抗性审计定位违规点,并在可验证接受标准下,以约束引导的最小干预进行修复。在六个基准数据集上的大量实验表明,该方法持续提升推理可靠性,同时保持竞争力的任务性能。
原文摘要 · Abstract (English)
In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing unsupported beliefs repeatedly stored and propagated across decision steps, leading to systematic behavioral drift in long-horizon agentic systems. Most existing strategies rely on the consensus mechanism, conflating agreement with faithfulness. In this paper, inspired by the vulnerability of unfaithful intermediate reasoning trajectories, we propose \textbf{S}elf-\textbf{A}udited \textbf{Ve}rified \textbf{R}easoning (\textsc{SAVeR}), a novel framework that enforces verification over internal belief states within the agent before action commitment, achieving faithful reasoning. Concretely, we structurally generate persona-based diverse candidate beliefs for selection under a faithfulness-relevant structure space. To achieve reasoning faithfulness, we perform adversarial auditing to localize violations and repair through constraint-guided minimal interventions under verifiable acceptance criteria. Extensive experiments on six benchmark datasets demonstrate that our approach consistently improves reasoning faithfulness while preserving competitive end-task performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。