让大模型具备心理理论能力,能推理他人想法并自我修正。
Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflection
- 分离置信度与心理状态,动态追踪对话方的信念欲望意图
- 通过反事实反思,使模型对齐预测与实际回应,提升推理效率
- 适用于情感对话与说服场景,适合研究社会行为模拟的研究者
近期研究显示大型语言模型具备显著的心理理论(ToM)能力,具备模拟生成智能体追踪他人心理状态的潜力。本文提出一种名为ToM-agent的新范式,旨在使基于大模型的生成智能体在开放域对话中模拟心理理论。ToM-agent将置信度与心理状态解耦,实现对对话方信念、欲望和意图(BDIs)的感知模拟。结合历史对话与言语反思,模型可动态调整对对方心理状态的推断及其置信水平。我们进一步提出反事实干预方法,通过对比预测回应与真实语句的差异进行反思,提升反思效率。在情感对话与说服对话数据集上评估发现,ToM-agent不仅能理解对方行为的深层动因,超越单纯语义-情绪支持或常识决策,还能有效完成一阶与二阶心理理论任务,为研究大规模语言模型模拟人类社交行为提供了新视角。
原文摘要 · Abstract (English)
Recent studies have increasingly demonstrated that large language models (LLMs) possess significant theory of mind (ToM) capabilities, showing the potential for simulating the tracking of mental states in generative agents. In this study, we propose a novel paradigm called ToM-agent, designed to empower LLMs-based generative agents to simulate ToM in open-domain conversational interactions. ToM-agent disentangles the confidence from mental states, facilitating the emulation of an agent's perception of its counterpart's mental states, such as beliefs, desires, and intentions (BDIs). Using past conversation history and verbal reflections, ToM-Agent can dynamically adjust counterparts' inferred BDIs, along with related confidence levels. We further put forth a counterfactual intervention method that reflects on the gap between the predicted responses of counterparts and their real utterances, thereby enhancing the efficiency of reflection. Leveraging empathetic and persuasion dialogue datasets, we assess the advantages of implementing the ToM-agent with downstream tasks, as well as its performance in both the first-order and the \textit{second-order} ToM. Our findings indicate that the ToM-agent can grasp the underlying reasons for their counterpart's behaviors beyond mere semantic-emotional supporting or decision-making based on common sense, providing new insights for studying large-scale LLMs-based simulation of human social behaviors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。