让大模型像人一样自我反思,提升推理准确性。
PSSD: Making Large Language Models Self-denial via Human Psyche Structure
- 借鉴人类心理结构,设计三角色协同的自我修正机制。
- 在多个基准上推理准确率显著提升,且无需额外训练。
- 适合需要高可靠推理的应用场景,如医疗与法律决策。
提升大语言模型推理准确性成为研究热点,现有后处理修正方法普遍存在资源消耗大、耗时长的问题。根本原因在于缺乏对模型自我否定能力的构建——即模型需自信识别潜在错误,并主动执行修正。然而,此类过程完全依赖模型内部,难以获取支持性依据,且即便发现问题也缺乏具体修正步骤。为此,本文提出PSSD,模拟人类心理结构,引入三个相互关联的角色:基于直觉的本我(id)提供初始推理;基于规则的超我(superego)提炼规则并给出指导;以脚本为中心的自我(ego)整合信息生成可执行脚本完成最终预测。大量实验表明,该设计不仅显著增强推理能力,且能无缝集成至现有模型,实现更优性能。
原文摘要 · Abstract (English)
The enhance of accuracy in reasoning results of LLMs arouses the community's interests, wherein pioneering studies investigate post-hoc strategies to rectify potential mistakes. Despite extensive efforts, they are all stuck in a state of resource competition demanding significant time and computing expenses. The cause of the situation lies in the failure of identifying the fundamental feature of the solutions in this line, coined as the self-denial of LLMs. In other words, LLMs should confidently determine the potential existence of mistakes and carefully execute the targeted correction. As the whole procedure conducts within LLMs, supporting and persuasive references are hard to acquire, while the absence of specific steps towards refining hidden mistakes persists even when errors are acknowledged. In response to the challenges, we present PSSD, which refers to and implements the human psyche structure such that three distinct and interconnected roles contribute to human reasoning. Specifically, PSSD leverages the recent multi-agent paradigm, and is further enhanced with three innovatively conceived roles: (1) the intuition-based id role that provides initial attempts based on benign LLMs; (2) the rule-driven superego role that summarizes rules to regulate the above attempts, and returns specific key points as guidance; and (3) the script-centric ego role that absorbs all procedural information to generate executable script for the final answer prediction. Extensive experiments demonstrate that the proposed design not only better enhance reasoning capabilities, but also seamlessly integrate with current models, leading to superior performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。