arXiv:2506.01820cs.AIcs.LG2025-06被引 4

神经网络仍无法实现类人系统性组合能力。

Fodor and Pylyshyn's Legacy: Still No Human-like Systematic Compositionality in Neural Networks

  • 重新审视元学习框架对组合性的支持
  • 发现现有方法仅在极受限条件下有效
  • 适合关注认知建模与神经网络局限的学者

系统性组合能力是应对现代复杂多变任务的重要技能。然而,在宣称元学习模型具备强适应能力时,需避免夸大其性能。尽管福多和皮利申曾指出,神经网络因无法建模组合表示或结构敏感操作,本质上缺乏这种能力,因而不适合作为人类心智的模型;而拉克与巴罗尼近期提出元学习可能是通往组合性的路径。本文对此观点进行批判性重审,指出当前元学习框架在组合性上的表现存在严重局限:现代神经元学习系统仅能在极为狭窄且受限的设定下完成相关任务。因此我们主张,‘福多与皮利申的遗产’依然成立——迄今为止,神经网络尚未实现类人的系统性组合能力。

原文摘要 · Abstract (English)

Strong meta-learning capabilities for systematic compositionality are emerging as an important skill for navigating the complex and changing tasks of today's world. However, in presenting models for robust adaptation to novel environments, it is important to refrain from making unsupported claims about the performance of meta-learning systems that ultimately do not stand up to scrutiny. While Fodor and Pylyshyn famously posited that neural networks inherently lack this capacity as they are unable to model compositional representations or structure-sensitive operations, and thus are not a viable model of the human mind, Lake and Baroni recently presented meta-learning as a pathway to compositionality. In this position paper, we critically revisit this claim and highlight limitations in the proposed meta-learning framework for compositionality. Our analysis shows that modern neural meta-learning systems can only perform such tasks, if at all, under a very narrow and restricted definition of a meta-learning setup. We therefore claim that `Fodor and Pylyshyn's legacy' persists, and to date, there is no human-like systematic compositionality learned in neural networks.

神经网络组合性元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。