让大模型学会区分现实与主观想法,提升社交推理能力。
Active Confusion Expression in Large Language Models: Leveraging World Models toward Better Social Reasoning
- 构建动态文本世界模型,跟踪角色状态和时间线
- 在推理卡顿时主动干预,准确率提升10%以上
- 适合需要精准社交理解的智能体应用
尽管大语言模型在数学和代码推理上表现优异,但在社交推理任务中常出现认知混乱、逻辑矛盾,并混淆客观世界状态与主观信念状态。通过对DeepSeek-R1推理轨迹的详细分析发现,模型在多参与者、多时间线场景下频繁陷入推理僵局,常输出‘棘手’‘困惑’等矛盾表述,导致错误推理或无限循环。根本原因在于无法区分客观现实与主体主观信念。为此,我们提出一种基于自适应世界模型增强的推理机制,通过构建动态文本世界模型追踪实体状态与时间序列,实时监测推理轨迹中的困惑信号,并在关键时刻提供清晰的世界状态描述,引导模型摆脱认知困境。该机制模仿人类使用隐含世界模型区分外部事件与内在信念的方式。在三个社交基准测试中,准确率显著提升(如Hi-ToM提升10%),同时计算成本降低达33.8%,为大模型在社交场景的应用提供了简单有效的解决方案。
原文摘要 · Abstract (English)
While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and subjective belief states. Through deteiled analysis of DeepSeek-R1's reasoning trajectories, we find that LLMs frequently encounter reasoning impasses and tend to output contradictory terms like "tricky" and "confused" when processing scenarios with multiple participants and timelines, leading to erroneous reasoning or infinite loops. The core issue is their inability to disentangle objective reality from agents' subjective beliefs. To address this, we propose an adaptive world model-enhanced reasoning mechanism that constructs a dynamic textual world model to track entity states and temporal sequences. It dynamically monitors reasoning trajectories for confusion indicators and promptly intervenes by providing clear world state descriptions, helping models navigate through cognitive dilemmas. The mechanism mimics how humans use implicit world models to distinguish between external events and internal beliefs. Evaluations on three social benchmarks demonstrate significant improvements in accuracy (e.g., +10% in Hi-ToM) while reducing computational costs (up to 33.8% token reduction), offering a simple yet effective solution for deploying LLMs in social contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。