arXiv:2410.11384physics.bio-phcs.AI2024-10被引 2

利用神经延迟实现可扩展分类,突破大脑学习架构僵局

Role of Delay in Brain Dynamics

  • 用多延迟网络生成多项式时间序列输出,固定结构支持更多类别
  • 延迟数量M决定输出能力,标签数超输入连接数时准确率显著提升
  • 模拟VGG-6在CIFAR上表现媲美可调单延迟模型,潜力未完全释放

神经元间连接延迟的差异通常导致脑动力学异步性,降低计算效率。但本研究发现,通过在相邻层间设置单一输出与M个不同延迟的网络结构,可将延迟劣势转化为计算优势,生成与延迟数M相关的多项式时间序列输出。所提出的脑动力学延迟角色(RoDiB)模型可在固定架构下学习不断增加的分类标签,克服大脑因增补神经元和连接而难以灵活更新学习结构的问题。其达到的准确率与具有M个输出的可调单延迟架构相当。当输出标签数超过全连接输入规模时,准确率显著提升。实验基于VGG-6在CIFAR数据集上的仿真,也涵盖多标签输入。目前仅使用了极少部分丰富的RoDiB输出,表明其潜在计算能力尚待发掘。

原文摘要 · Abstract (English)

Significant variations of delays among connecting neurons cause an inevitable disadvantage of asynchronous brain dynamics compared to synchronous deep learning. However, this study demonstrates that this disadvantage can be converted into a computational advantage using a network with a single output and M multiple delays between successive layers, thereby generating a polynomial time-series outputs with M. The proposed role of delay in brain dynamics (RoDiB) model, is capable of learning increasing number of classified labels using a fixed architecture, and overcomes the inflexibility of the brain to update the learning architecture using additional neurons and connections. Moreover, the achievable accuracies of the RoDiB system are comparable with those of its counterpart tunable single delay architectures with M outputs. Further, the accuracies are significantly enhanced when the number of output labels exceeds its fully connected input size. The results are mainly obtained using simulations of VGG-6 on CIFAR datasets and also include multiple label inputs. However, currently only a small fraction of the abundant number of RoDiB outputs is utilized, thereby suggesting its potential for advanced computational power yet to be discovered.

神经动力学延迟机制可扩展学习类脑计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。