arXiv:2607.02283cs.NEcs.LG2026-07

单层脉冲网络通过树突动态实现上下文学习,无需注意力或深度。

Dendritic In-Context Learning in a Single-Layer Spiking Neural Network

论文配图:Dendritic In-Context Learning in a Single-Layer Spiking Neural Network
图 1 · 摘自论文原文
  • 用树突的亚阈值动态替代传统塑性,直接实现在线学习算法。
  • 在高维任务上稳定表现,线性探测复现参考轨迹(R²=0.93)。
  • 适合研究生物可解释性与低功耗神经计算的学者。

上下文学习(ICL)通过现代AI架构(如Transformer、Mamba)前向传播中嵌入的隐式梯度下降实现。现有脉冲神经网络(SNN)难以在非平凡任务维度下通过Garg-2022基准测试。我们发现根源在于结构假设:先前SNN将适应性归因于推理时的突触可塑性,视树突为被动误差信号通道。本文挑战此假设,指出单个树突区段的亚阈值动力学本身即可实现完整的在线学习算法。提出DendriCL——一种单层分隔式脉冲架构,其顶端回环结构与漏失在线Widrow-Hoff LMS完全一致。仅靠动力学更新,即可将通用ICL所需的架构深度压缩至单层。DendriCL在超维Garg-2022 ICL任务中具有唯一种子稳定性,而密集型Transformer在此类任务中出现类似‘领悟’的不稳定性并失效。线性探测显示,从顶端膜电位可直接恢复参考在线LMS轨迹,相关系数达R²=0.93,表明算法已结构性嵌入动力学而非训练中被发现。综上,ICL无需注意力、深度或推理时可塑性:一个具备在线LMS动力学的单个树突区段即足够。

原文摘要 · Abstract (English)

In-context learning (ICL) operates via implicit gradient descent embedded in the forward pass of modern AI architectures -- Transformers, Mamba, state-space models, and MLPs. Capturing this capability in biologically plausible Spiking Neural Networks (SNNs) has remained an open challenge: existing SNNs fail the Garg-2022 benchmark at non-trivial task dimensions. We trace this failure to a structural assumption: prior SNN designs route adaptation through inference-time synaptic plasticity, viewing the dendritic compartment as a passive conduit for error or teacher signals. We challenge this assumption. The subthreshold dynamics of a single dendritic compartment already implement a complete online learning algorithm. By treating the compartment as the computational substrate rather than a passive conduit, we propose DendriCL -- a single-layer compartmental spiking architecture whose apical recurrence is structurally identical to leaky online Widrow-Hoff LMS. This dynamics-only update collapses the architectural depth required for general-purpose ICL to a single layer. DendriCL is uniquely seed-stable at super-dimensional Garg-2022 ICL -- where dense Transformers exhibit grokking-style instability and fail past moderate task dimension -- and a linear probe recovers the reference online-LMS trajectory directly from the apical membrane at R^2 = 0.93, showing the algorithm is structurally embedded in the dynamics rather than implicitly discovered during training. Taken together, ICL requires neither attention, depth, nor inference-time plasticity: a single compartment with online-LMS dynamics is sufficient.

脉冲神经网络树突计算在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。