arXiv:2601.02378cs.RO2026-01综述被引 1

构建具身智能体的心理世界模型,推动人机自然协作。

Modeling the Mental World for Embodied AI: A Comprehensive Review

  • 提出心理世界模型理论框架,区分其与物理世界模型的本质差异。
  • 系统定义心理元素表示的两种范式,整合19种心智推理方法。
  • 梳理26个评测基准,推动神经符号融合架构发展。

随着具身智能体在虚拟形象、可穿戴设备和机器人系统中的应用不断深入,其核心研究挑战逐渐从物理环境交互转向对社交互动的准确理解。传统物理世界模型(PWM)仅关注空间、运动等可量化属性,难以满足社交智能建模需求。相比之下,心理世界模型(MWM)作为人类内部心理状态的结构化表征,已成为具身智能体实现自然人机协作与动态社交适应的关键认知基础。然而当前MWM研究面临三大瓶颈:概念框架零散、MWM与PWM边界模糊;不同心智理论(ToM)推理范式的技术路径与应用场景脱节;评估体系与实际应用分离。本文综述超100篇权威文献,首次构建完整的MWM理论框架,明确区分MWM与PWM的本质差异;通过两种心智元素表示范式系统定义MWM核心组件;全面分析两类核心ToM推理范式及19种具体方法;并梳理神经符号混合架构的融合趋势,整合26个ToM评测基准。该工作旨在促进具身智能体融入人类社会,推动人机协同交互的深入发展。

原文摘要 · Abstract (English)

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of social interactions. Traditional physical world models (PWM) focus on quantifiable physical attributes such as space and motion, failing to meet the needs of social intelligence modeling. In contrast, the Mental World Model (MWM), as a structured representation of humans' internal mental states, has become the critical cognitive foundation for embodied agents to achieve natural human-machine collaboration and dynamic social adaptation. However, current MWM research faces significant bottlenecks: such as fragmented conceptual framework with vague boundaries between MWM and PWM, disjointed reasoning mechanisms for the technical pathways and applicable scenarios of different Theory of Mind (ToM) reasoning paradigms, and detachment between evaluation and practice. To address these issues, this review systematically synthesizes over 100 authoritative studies to provide a comprehensive overview of MWM research for embodied AI. Its core contributions are threefold: First, it constructs a complete theoretical framework for MWM for the first time. Specifically, it distinguishes the essential differences between MWM and PWMs. Second, it systematically defines the key components of MWM through two paradigms for mental element representation. Third, it comprehensively analyzes two core ToM reasoning paradigms with 19 ToM methods. Finally, it also clarifies the integration trend of neuro-symbolic hybrid architectures, and synthesizes 26 ToM evaluation benchmarks. This work aims to promote the integration of embodied agents into human society and advance the in-depth development of human-machine collaborative interaction.

具身智能心理建模人机协作心智理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。