用视觉心智理论让智能体发明原始文字,揭示人类书写起源的认知机制。
Visual Theory of Mind Enables the Invention of Proto-Writing
- 构建多智能体符号游戏,模拟通过视觉类比生成象形符号的通信过程。
- 智能体在具备视觉心智理论时,能更高效地用象形符号传递动作意图。
- 为原始文字诞生提供认知与文化演化的计算模型,适合对认知科学感兴趣的读者。
符号书写系统是现代社会无处不在的图形表意代码,但在动物界中并不存在。人类学证据表明,某些书写系统的最早形式由具象象形图构成,通过视觉相似性指代对象。以往研究分别从计算角度探讨了象形系统的出现与演化,但大多采用非自然的方法,难以与人类及动物认知建立清晰类比。本文提出一种名为「符号化博弈」的多智能体强化学习测试平台,构建了一种推断性通信模型,使智能体能利用视觉理论心智,通过象形符号传递动作信息。该模型嵌入更广泛的动物通信形式体系,揭示了原始文字产生的认知与文化机制。
原文摘要 · Abstract (English)
Symbolic writing systems are graphical semiotic codes that are ubiquitous in modern society but are otherwise absent in the animal kingdom. Anthropological evidence suggests that the earliest forms of some writing systems originally consisted of iconic pictographs, which signify their referent via visual resemblance. While previous studies have examined the emergence and, separately, the evolution of pictographic systems through a computational lens, most employ non-naturalistic methodologies that make it difficult to draw clear analogies to human and animal cognition. We develop a multi-agent reinforcement learning testbed for emergent communication called a Signification Game, and formulate a model of inferential communication that enables agents to leverage visual theory of mind to communicate actions using pictographs. Our model, which is situated within a broader formalism for animal communication, sheds light on the cognitive and cultural processes underlying the emergence of proto-writing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。