让智能助手直接重建用户心理状态,提升理解力与响应准确性。
UserHarness: Harnessing User Minds for Stronger Agent Theory-of-Mind

- 将用户心智显式建模为观察、信念、意图和行为的完整链条。
- 在五个基准测试中最高达95.94%准确率,比现有方法提升超15%。
- 适合需要深度用户理解的对话系统与个性化助理开发。
理解用户的信念与意图是构建高效智能助手的核心。这一能力通常通过心智理论(ToM)任务评估,要求代理从用户视角进行推理。然而,现有方法多采用复杂间接的建模流程,未显式重构用户心理状态。这忽略了问题本质:用户基于其信念行动,信念随环境观察更新;信念与意图共同决定行为,行为又改变环境;社会推理常需嵌套信念(如对他人信念的认知)。我们提出UserHarness,一个将ToM推理重构为显式用户心智重建的简单框架。该框架分解用户心理状态、与外部环境的关系及其引发的行为,使代理能追踪用户所见、所信、所图及所行。在五个基准测试中,UserHarness达到最高95.94%的宏平均准确率,相比现有推理方法提升超过15%,相比最强仅用提示的方案提升约20%。结果表明,稳健的用户理解需从用户心智根源出发,用户重构有望成为未来更自适应助手的基础。
原文摘要 · Abstract (English)
Understanding what a user believes and intends is central to building effective agent assistants. This ability is often evaluated through Theory-of-Mind (ToM) tasks, where success requires reasoning from the user's perspective. However, many existing approaches address ToM with complex pipelines that model behavior indirectly, without explicitly reconstructing the user's mental state. This misses the core structure of the problem: users act based on their beliefs, which are updated through observations of the environment; beliefs and intentions jointly determine actions, which in turn change the environment; and social reasoning often requires nested beliefs about what others believe or intend. We propose UserHarness, a simple framework that reframes ToM reasoning as explicit user-mind reconstruction. UserHarness decomposes the user's mental state, its relation to the external environment, and the actions that follow from it, enabling agents to track what the user observes, believes, intends, and does. Across five benchmarks, UserHarness reaches up to 95.94% macro accuracy, improving over existing inference methods by more than 15% relative and over the strongest prompt-only harness by about 20% relative. These results suggest that robust user understanding requires reasoning from the roots of the user's mind, positioning user harnessing as a promising foundation for more adaptive future assistants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。