用动态细胞自动机模拟学习记忆,仅靠简单生物机制就能高效建模认知行为。
A Computational Model of Learning and Memory Using Structurally Dynamic Cellular Automata
- 基于巧合检测、信号调制等生物合理机制构建可变结构的细胞自动机。
- 单次训练即可近似最优地重寻奖励状态,且在稀疏奖励中自发探索。
- 适合研究认知计算底层机制,尤其关注记忆与行为的神经动力学模型。
在计算与神经科学领域,学习、记忆、抽象和行为等关键认知功能背后的计算机制仍不明确。本文提出一种基于少量生物合理函数(包括巧合检测、信号调制和奖惩机制)的数学与计算模型。理论认为,这些基础功能足以构建并调控一个信息空间,支持推理与行为计算,产生可利用的信号梯度。实验采用具有连续状态的结构动态细胞自动机,通过无向图上的递归传播进行计算,记忆功能完全嵌入于图边的生成与调制过程。结果表明:该模型在单次训练后能近似最优地重新发现奖励状态;能有效避开复杂惩罚配置;信号调制与网络可塑性可在稀疏奖励环境中生成探索行为;能生成上下文依赖的记忆表征;且因仅需单次训练、记忆表达灵活,展现出高计算效率。
原文摘要 · Abstract (English)
In the fields of computation and neuroscience, much is still unknown about the underlying computations that enable key cognitive functions including learning, memory, abstraction and behavior. This paper proposes a mathematical and computational model of learning and memory based on a small set of bio-plausible functions that include coincidence detection, signal modulation, and reward/penalty mechanisms. Our theoretical approach proposes that these basic functions are sufficient to establish and modulate an information space over which computation can be carried out, generating signal gradients usable for inference and behavior. The computational method used to test this is a structurally dynamic cellular automaton with continuous-valued cell states and a series of recursive steps propagating over an undirected graph with the memory function embedded entirely in the creation and modulation of graph edges. The experimental results show: that the toy model can make near-optimal choices to re-discover a reward state after a single training run; that it can avoid complex penalty configurations; that signal modulation and network plasticity can generate exploratory behaviors in sparse reward environments; that the model generates context-dependent memory representations; and that it exhibits high computational efficiency because of its minimal, single-pass training requirements combined with flexible and contextual memory representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。