arXiv:2602.13832cs.CL2026-02被引 1

让大模型理解用户真实想法,提升人机协作效率

Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind

  • 将心智理论建模为认知差异检测与修复机制
  • 11个主流模型均难以识别影响任务成功的认知盲区
  • 基于轨迹的训练数据使模型推理用户心理状态能力显著提升

大语言模型在辅助人类完成通用及专业任务方面已广泛应用,但在意图表达模糊时仍难以理解真实需求,导致用户主观信念与环境真实状态之间产生认知偏差。解决这一认知分歧需依赖心智理论(ToM),但现有评估多集中于孤立信念推断,忽视其在实际交互中的功能价值。为此,本文将LLM的心智理论形式化为认知差异的检测与化解机制,并提出基准测试 enchname,评估模型在实践中调和用户信念与身份特征的能力。对11个领先模型的测试显示,它们普遍难以识别阻碍任务成功的核心认知缺口。为进一步弥补此差距,我们构建了一个基于轨迹的心智理论数据集,将信念追踪与任务相关状态推断相连接。采用强化学习在该数据上训练的模型,在推理用户心理状态方面表现持续提升,进而改善下游任务性能。本研究强调了心智理论作为交互层面核心机制的实际价值,而非仅是独立推理技能。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have developed rapidly and are widely applied to both general-purpose and professional tasks to assist human users. However, they still struggle to comprehend and respond to the true user needs when intentions and instructions are imprecisely conveyed, leading to a divergence between subjective user believes and true environment states. Resolving this epistemic divergence requires Theory of Mind (ToM), yet existing ToM evaluations for LLMs primarily focus on isolated belief inference, overlooking its functional utility in real-world interaction. To this end, we formalize ToM for LLMs as a mechanism for epistemic divergence detection and resolution, and propose a benchmark, \benchname, to assess how models reconcile user beliefs and profiles in practice. Results across 11 leading models reveal a significant limitation to identify underlying cognitive gaps that impede task success. To bridge this gap, we further curate a trajectory-based ToM dataset linking belief tracking with task-related state inference. The model trained on this data via reinforcement learning shows consistent improvement in reasoning about user mental states, leading to enhanced downstream performance. Our work highlights the practical value of ToM as an essential interaction-level mechanism rather than as a standalone reasoning skill.

心智理论人机交互大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。