用张量脑模型统一感知与符号,实现感官与概念的动态融合。
How the (Tensor-) Brain uses Embeddings and Embodiment to Encode Senses and Symbols
- 分层结构:表征层处理感知,索引层存储符号。
- 双向激活:感官输入触发符号,符号回控感知过程。
- 嵌入作为知识基因,整合多模态经验与抽象概念。
张量脑(Tensor Brain, TB)是一种用于感知与记忆的计算模型。本文综述了TB模型的最新进展与功能机制。该模型由表征层和索引层构成:表征层模拟无符号全局工作空间,其状态反映认知状态,捕捉感官与认知过程的动态交互;索引层则包含概念、时间实例与谓词等符号表示。在自下而上的操作中,感官输入激活表征层,进而触发索引层中的关联符号标签;反之,在自上而下的操作中,索引层的符号激活表征层,并通过具身化影响早期处理层。这一机制支撑语义记忆,使抽象知识融入感知与认知过程。核心特征是概念嵌入,它们作为连接索引层与表征层的权重,如同概念的‘基因’,整合来自多样化经验、感官模态及符号表示的知识,形成统一的学习与记忆框架。
原文摘要 · Abstract (English)
The Tensor Brain (TB) has been introduced as a computational model for perception and memory. This paper provides an overview of the TB model, incorporating recent developments and insights into its functionality. The TB is composed of two primary layers: the representation layer and the index layer. The representation layer serves as a model for the subsymbolic global workspace, a concept derived from consciousness research. Its state represents the cognitive brain state, capturing the dynamic interplay of sensory and cognitive processes. The index layer, in contrast, contains symbolic representations for concepts, time instances, and predicates. In a bottom-up operation, sensory input activates the representation layer, which then triggers associated symbolic labels in the index layer. Conversely, in a top-down operation, symbols in the index layer activate the representation layer, which in turn influences earlier processing layers through embodiment. This top-down mechanism underpins semantic memory, enabling the integration of abstract knowledge into perceptual and cognitive processes. A key feature of the TB is its use of concept embeddings, which function as connection weights linking the index layer to the representation layer. As a concept's ``DNA,'' these embeddings consolidate knowledge from diverse experiences, sensory modalities, and symbolic representations, providing a unified framework for learning and memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。