用脉冲神经网络让大模型自主思考,无需外部触发就能主动发起对话。
EMBER: Autonomous Cognitive Behaviour from Learned Spiking Neural Network Dynamics in a Hybrid LLM Architecture
- 将大模型嵌入生物启发的脉冲网络中,用突触可塑性实现自主认知决策。
- 仅7次对话后即触发首次自主行为,8小时空闲后自发联系用户。
- 适用于需要持续学习与主动交互的智能体系统,如个性化助手。
我们提出(经验调节的生物启发式涌现推理)架构,重构大语言模型(LLM)与记忆的关系:不通过检索工具增强LLM,而是将LLM作为可替换的推理引擎置于持久、生物基础的关联基质中。核心是一个22万神经元的脉冲神经网络(SNN),具备尖峰时间依赖可塑性(STDP)、四层分层结构(感知/概念/类别/元模式)、抑制性兴奋平衡及奖励调节学习。文本嵌入通过一种新颖的z-score标准化top-k种群编码方式注入SNN,该方法维度无关,可在不同嵌入维度下保持82.2%的判别保留率。我们发现,在空闲期间,STDP的横向传播能触发并塑造LLM行为,无需外部提示或脚本触发:由SNN决定何时行动及调用哪些关联,而LLM负责选择动作类型并生成内容。某次实验中,系统在8小时空闲期间通过学习到的人-主题关联横向激活后,自主发起与用户的联系。从零权重初始化开始,仅经14条消息(7轮对话)即产生首个由SNN触发的行为。
原文摘要 · Abstract (English)
We present (Experience-Modulated Biologically-inspired Emergent Reasoning), a hybrid cognitive architecture that reorganises the relationship between large language models (LLMs) and memory: rather than augmenting an LLM with retrieval tools, we place the LLM as a replaceable reasoning engine within a persistent, biologically-grounded associative substrate. The architecture centres on a 220,000-neuron spiking neural network (SNN) with spike-timing-dependent plasticity (STDP), four-layer hierarchical organisation (sensory/concept/category/meta-pattern), inhibitory E/I balance, and reward-modulated learning. Text embeddings are encoded into the SNN via a novel z-score standardised top-k population code that is dimension-independent by construction, achieving 82.2\% discrimination retention across embedding dimensionalities. We show that STDP lateral propagation during idle operation can trigger and shape LLM actions without external prompting or scripted triggers: the SNN determines when to act and what associations to surface, while the LLM selects the action type and generates content. In one instance, the system autonomously initiated contact with a user after learned person-topic associations fired laterally during an 8-hour idle period. From a clean start with zero learned weights, the first SNN-triggered action occurred after only 7 conversational exchanges (14 messages).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。