语言是群体共同构建的外部记忆与注意力系统。
Beyond Individuals: Collective Predictive Coding for Memory, Attention, and the Emergence of Language
- 提出集体预测编码框架,将记忆与注意力扩展到群体层面。
- 语言作为分布语义的外在表征,由群体共同学习形成。
- 适合对群体认知、语言演化感兴趣的读者。
本文从集体预测编码(CPC)假说出发,将记忆与注意力的认知机制从个体层面拓展至群体层面。该框架认为,语言作为一种嵌入分布语义的外部表征,是群体协作形成的产物。通过共同的下一词预测学习,群体逐渐构建出共享的世界模型。这一过程不仅塑造了集体认知,也推动了语言结构的涌现。研究为理解语言如何从群体互动中产生提供了新视角。
原文摘要 · Abstract (English)
This commentary extends the discussion by Parr et al. on memory and attention beyond individual cognitive systems. From the perspective of the Collective Predictive Coding (CPC) hypothesis -- a framework for understanding these faculties and the emergence of language at the group level -- we introduce a hypothetical idea: that language, with its embedded distributional semantics, serves as a collectively formed external representation. CPC generalises the concepts of individual memory and attention to the collective level. This offers a new perspective on how shared linguistic structures, which may embrace collective world models learned through next-word prediction, emerge from and shape group-level cognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。