神经网络可自发实现高阶心智理论,无需依赖高级技能。
Spontaneous High-Order Generalization in Neural Theory-of-Mind Networks
- 构建最小认知系统ToMNN,仅训练一阶心智理论能力。
- 二阶和三阶心智理论准确率显著高于随机水平。
- 表现模式符合人类认知规律,适用于不同规模模型。
心智理论(ToM)是人类认知的核心能力,用于理解自我与他人的心理状态。Wimmer和Perner表明,人类在短时间内从一阶发展到高阶心智理论,且这一过程发生在正式教育或高级技能习得之前。相比之下,自回归语言模型等神经网络需伴随推理等高级技能提升才能实现从一阶到高阶的跃迁,其发展路径是否可独立于高级技能尚不明确。本研究提供证据表明,神经网络可自发实现从一阶到高阶心智理论的泛化,无需依赖高级技能。我们提出神经心智理论网络(ToMNN),模拟一个仅具备一阶心智理论能力的最小认知系统。评估显示其在二阶和三阶心智理论任务上准确率显著高于随机水平。此外,该网络在从一阶到二阶泛化时表现出更明显的性能下降,且准确率随任务复杂度增加而降低,这种难度感知模式与人类认知预期一致。结果在不同参数规模下均具普遍性。研究揭示了机器心智理论泛化的潜在规律,为构建更类人认知系统提供了基础。
原文摘要 · Abstract (English)
Theory-of-Mind (ToM) is a core human cognitive capacity for attributing mental states to self and others. Wimmer and Perner demonstrated that humans progress from first- to higher-order ToM within a short span, completing this development before formal education or advanced skill acquisition. In contrast, neural networks represented by autoregressive language models progress from first- to higher-order ToM only alongside gains in advanced skills like reasoning, leaving open whether their trajectory can unfold independently, as in humans. In this research, we provided evidence that neural networks could spontaneously generalize from first- to higher-order ToM without relying on advanced skills. We introduced a neural Theory-of-Mind network (ToMNN) that simulated a minimal cognitive system, acquiring only first-order ToM competence. Evaluations of its second- and third-order ToM abilities showed accuracies well above chance. Also, ToMNN exhibited a sharper decline when generalizing from first- to second-order ToM than from second- to higher orders, and its accuracy decreased with greater task complexity. These perceived difficulty patterns were aligned with human cognitive expectations. Furthermore, the universality of results was confirmed across different parameter scales. Our findings illuminate machine ToM generalization patterns and offer a foundation for developing more human-like cognitive systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。