arXiv:2509.00559cs.AI2025-09被引 9

用结构化表示让AI理解他人心理,显著提升社交推理能力。

Social World Models

  • 提出S3AP结构化表示法,显式建模智能体的意图、信念和动态状态
  • 在FANToM上比o1模型性能提升51%,在SOTOPIA上提升18%
  • 适合开发具备社会感知能力的对话与交互系统

人类能通过模拟隐性社交动态和推断他人的视角来应对社交互动,即使信息有限。相比之下,现有AI系统缺乏对未观察到的动态(如意图、信念、演变中的社会状态)的显式表征,难以有效构建社交语境。本文提出社会世界模型(SWM),并引入新型结构化社会世界表征形式S3AP,以捕捉智能体的演化状态、行为及心理状态,弥补传统自由文本输入中缺乏显式结构的不足。在五个社交推理基准上的实验表明,S3AP显著提升大语言模型性能——在FANToM上较OpenAI o1模型提升51%。消融实验显示,这些增益主要源于对隐藏心理状态的显式建模,优于多种基线方法。进一步提出基于S3AP的社会世界模型算法,使AI智能体能够构建对话对象的模型,预测其下一步行为与心理状态。在多轮社交交互基准SOTOPIA上,该模型实现最高18%的性能提升。结果表明,S3AP是一种强大且通用的社会状态表征,可推动更富社会意识系统的研发。

原文摘要 · Abstract (English)

Humans intuitively navigate social interactions by simulating unspoken dynamics and reasoning about others' perspectives, even with limited information. In contrast, AI systems struggle to structure and reason about implicit social contexts, as they lack explicit representations for unobserved dynamics such as intentions, beliefs, and evolving social states. In this paper, we introduce the concept of social world models (SWMs) to characterize the complex social dynamics. To operationalize SWMs, we introduce a novel structured social world representation formalism (S3AP), which captures the evolving states, actions, and mental states of agents, addressing the lack of explicit structure in traditional free-text-based inputs. Through comprehensive experiments across five social reasoning benchmarks, we show that S3AP significantly enhances LLM performance-achieving a +51% improvement on FANToM over OpenAI's o1. Our ablations further reveal that these gains are driven by the explicit modeling of hidden mental states, which proves more effective than a wide range of baseline methods. Finally, we introduce an algorithm for social world models using S3AP, which enables AI agents to build models of their interlocutors and predict their next actions and mental states. Empirically, S3AP-enabled social world models yield up to +18% improvement on the SOTOPIA multi-turn social interaction benchmark. Our findings highlight the promise of S3AP as a powerful, general-purpose representation for social world states, enabling the development of more socially-aware systems that better navigate social interactions.

社会推理心智建模LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。