arXiv:2507.03682cs.AIcs.LG2025-07被引 5

用大模型辅助逆向规划,让机器更准地猜人心理。

Towards Machine Theory of Mind with Large Language Model-Augmented Inverse Planning

  • 用大模型生成假设和似然函数,结合贝叶斯逆向规划推断心理状态。
  • 在类逆向规划任务中逼近最优表现,优于纯大模型或思维链提示的模型。
  • 可推广至开放任务,适合构建有社会智能的生成式代理。

我们提出一种混合方法来实现机器理论心理(ToM),利用大语言模型(LLMs)生成假设和似然函数,结合贝叶斯逆向规划模型,根据行为推断代理可能的心理状态。贝叶斯逆向规划模型在多种ToM任务上能准确预测人类推理,但难以扩展到包含大量假设和行为的场景。而基于LLM的方法虽在ToM基准上表现出潜力,却在结构相同任务中仍易出错。本方法结合两者优势,在受控任务中接近最优结果,且在小规模LLM下仍优于仅使用LLM或带思维链提示的模型。此外,该模型还能在开放式任务中预测心理状态,为未来社交智能生成代理的发展提供新方向。

原文摘要 · Abstract (English)

We propose a hybrid approach to machine Theory of Mind (ToM) that uses large language models (LLMs) as a mechanism for generating hypotheses and likelihood functions with a Bayesian inverse planning model that computes posterior probabilities for an agent's likely mental states given its actions. Bayesian inverse planning models can accurately predict human reasoning on a variety of ToM tasks, but these models are constrained in their ability to scale these predictions to scenarios with a large number of possible hypotheses and actions. Conversely, LLM-based approaches have recently demonstrated promise in solving ToM benchmarks, but can exhibit brittleness and failures on reasoning tasks even when they pass otherwise structurally identical versions. By combining these two methods, this approach leverages the strengths of each component, closely matching optimal results on a task inspired by prior inverse planning models and improving performance relative to models that utilize LLMs alone or with chain-of-thought prompting, even with smaller LLMs that typically perform poorly on ToM tasks. We also exhibit the model's potential to predict mental states on open-ended tasks, offering a promising direction for future development of ToM models and the creation of socially intelligent generative agents.

理论心理大模型逆向规划社会智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。