arXiv:2606.00240cs.AIcs.MA2026-06被引 1

让AI通过自我监督学习在线推断人类心理,无需人工标注。

MindZero: Learning Online Mental Reasoning With Zero Annotations

论文配图:MindZero: Learning Online Mental Reasoning With Zero Annotations
图 1 · 摘自论文原文
  • 用自监督强化学习训练多模态大模型,自动生成心理状态假设。
  • 在网格世界和家庭场景中,准确率高于传统方法,推理速度提升数倍。
  • 适合需要实时理解用户意图的智能助手,尤其适用于无标注数据场景。

实现有效现实辅助需具备强理论心理(ToM)能力的AI代理:从行为推断人类心理状态。尽管已有进展,仍面临三大挑战:(1) 多假设下的在线推断与鲁棒不确定性更新;(2) 适合实时辅助的高效推理;(3) 现实领域缺乏真实心理状态标注。本文提出MindZero,一种自监督强化学习框架,用于训练多模态大语言模型(MLLMs)进行高效且鲁棒的在线心理推理。训练中,模型因生成能最大化规划器估计的观察行为似然的心理状态假设而获得奖励,类似基于模型的ToM推理。该方法无需显式心理状态标注。训练后,MindZero将基于模型的推理内化为快速单次遍历推理。我们在网格世界与家庭场景中的复杂心理推理及AI辅助任务上评估了MindZero,结果表明:仅使用LLMs效果不足;基于模型的方法虽提升准确率但速度慢、成本高且受限于底层MLLM容量。相比之下,MindZero显著增强MLLM的内在ToM能力,在准确率与效率上均大幅优于基线,证明心理推理可作为自监督技能有效习得。

原文摘要 · Abstract (English)

Effective real-world assistance requires AI agents with robust Theory of Mind (ToM): inferring human mental states from their behavior. Despite recent advances, several key challenges remain, including (1) online inference with robust uncertainty updates over multiple hypotheses; (2) efficient reasoning suitable for real-time assistance; and (3) the lack of ground-truth mental state annotations in real-world domains. We address these challenges by introducing MindZero, a self-supervised reinforcement learning framework that trains multimodal large language models (MLLMs) for efficient and robust online mental reasoning. During training, the model is rewarded for generating mental state hypotheses that maximize the likelihood of observed actions estimated by a planner, similar to model-based ToM reasoning. This method thus eliminates the need for explicit mental state annotations. After training, MindZero internalizes model-based reasoning into fast single-pass inference. We evaluate MindZero against baselines across challenging mental reasoning and AI assistance tasks in gridworld and household domains. We found that LLMs alone are insufficient; model-based methods improve accuracy but are slow, costly, and limited by backbone MLLM capacity. In contrast, MindZero enhances MLLMs' intrinsic ToM ability and significantly outperforms model-based methods in both accuracy and efficiency, showing that mental reasoning can be effectively learned as a self-supervised skill.

理论心理自监督智能助手

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。