arXiv:2607.27201cs.CL2026-07

建模人类心理状态,让AI更懂人的行为逻辑

Mental World Modeling

论文配图:Mental World Modeling
图 1 · 摘自论文原文
  • 将心理状态纳入世界模型核心,与物理状态共同演化
  • 在多模态决策数据集上,显式建模心理状态可显著提升预测准确率
  • 框架可解释性强,适合研究人类决策与AI推理的交互

世界模型通常只关注物理世界的演化,但人类行为受隐藏心理状态(信念、欲望、意图、感受及社会规范认知)驱动。仅追踪物理场景而忽略代理对场景的认知,会导致对行为的错误预测。本文提出心智世界建模(Mental World Modeling, MWM),将心理变量作为世界模型的核心组件而非事后解释。MWM维护耦合的物理-心理状态,生成目标相关的部分观测,并模拟候选行为如何同时更新两部分状态。我们构建了无需训练、完全可解释的基线模型MENTIS,包含状态解析、目标观测生成、动作分解、耦合状态转移和分支价值评估五个模块。在涵盖文本、图像和音视频故事的高质量人工构建决策场景数据集上,8个基于大语言模型的世界模型实验表明,显式建模心理状态对预测人类决策至关重要。深入分析揭示了当前心智建模的关键瓶颈。MWM代表世界模型发展的下一阶段:从模拟物理场景转向模拟行动者的内在心智。

原文摘要 · Abstract (English)

World models enable a predictive substrate for planning and action, yet existing formulations merely answer a physical question: what/where it is, and how will it evolve. Human behavior, however, is driven by hidden mental state (what a person believes, wants, intends, feels, and considers socially permissible), so a model that tracks the physical scene but not what each agent knows and believes about it predicts the wrong action for the right-looking scene. We formulate Mental World Modeling (MWM), a generic theoretical framework that makes mental variables core components of a world model rather than posthoc rationales: MWM aintains a coupled physical-mental world state, renders a target-specific partial observation, and simulates how candidate actions jointly update both components. We instantiate the framework in MENTIS, a training-free and fully inspectable baseline that decomposes the process into state parsing, target-observation generation, action decomposition, coupled physical and mental transition, and branch-level value evaluation. On a manually constructed, quality-controlled dataset of situated decision scenarios spanning text, image, and sounding-video stories, experiments with 8 modern LLM-based world models demonstrate that explicitly modeling the mental state is essential for predicting human decisions. Deeper analyses further expose the bottlenecks of current mental world modeling. We expect MWM as a next stage of world modeling, from simulating physical scenes to simulating the minds that act in them.

世界模型心理建模决策预测可解释AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。