arXiv:2509.18758q-bio.NCcs.AI2025-09

对比两种神经网络结构的动态复杂性,发现枢纽节点关键作用

Complexity of Activity Patterns in a Bio-Inspired Hopfield-Type Network in Different Topologies

  • 用时序复杂性理论分析生物启发的霍普菲尔德网络
  • 两类拓扑均呈现幂律衰减活动分布,但无标度网络噪声更低
  • 枢纽节点对复杂动力学模式至关重要,适合神经科学与复杂系统研究者

具有记忆存储能力的神经网络模型在计算机科学与计算神经科学中被广泛研究。霍普菲尔德网络是用于关联或内容寻址记忆的典型模型,已有多种形式被分析。此外,复杂网络理论中的思想和方法被引入人工神经网络与学习中,强调其结构特性。然而,生物神经网络的时序动态同样重要,其时序结构是需重点考察的关键特征。生物神经网络表现出复杂的间歇性,可通过时序复杂性(TC)理论进行研究。TC方法关注自组织状态的元稳定性,表现为事件间隔时间分布的幂律衰减、总活动分布的幂律特性或事件驱动扩散过程的标度行为。本研究对一种生物启发的霍普菲尔德型神经网络模型进行了时序复杂性(TC)分析,比较了无标度与随机网络拓扑下的全局激活模式。参数分析显示两类架构的动力学行为相近。对时序复杂性的进一步研究发现,看似不同的动力学模式展现出相似的时序复杂性行为:两者均出现活动分布的幂律衰减,且复杂性水平相当,但无标度拓扑的噪声显著降低。多数复杂动力学轮廓在无标度网络配置中持续出现,证实了枢纽节点在神经网络动力学中的关键作用。

原文摘要 · Abstract (English)

Neural network models capable of storing memory have been extensively studied in computer science and computational neuroscience. The Hopfield network is a prototypical example of a model designed for associative, or content-addressable, memory and has been analyzed in many forms. Further, ideas and methods from complex network theory have been incorporated into artificial neural networks and learning, emphasizing their structural properties. Nevertheless, the temporal dynamics also play a vital role in biological neural networks, whose temporal structure is a crucial feature to examine. Biological neural networks display complex intermittency and, thus, can be studied through the lens of the temporal complexity (TC) theory. The TC approach look at the metastability of self-organized states, characterized by a power-law decay in the inter-event time distribution and in the total activity distribution or a scaling behavior in the corresponding event-driven diffusion processes. In this study, we present a temporal complexity (TC) analysis of a biologically-inspired Hopfield-type neural network model. We conducted a comparative assessment between scale-free and random network topologies, with particular emphasis on their global activation patterns. Our parametric analysis revealed comparable dynamical behaviors across both neural network architectures. Furthermore, our investigation into temporal complexity characteristics uncovered that seemingly distinct dynamical patterns exhibit similar temporal complexity behaviors. In particular, similar power-law decay in the activity distribution and similar complexity levels are observed in both topologies, but with a much reduced noise in the scale-free topology. Notably, most of the complex dynamical profiles were consistently observed in scale-free network configurations, thus confirming the crucial role of hubs in neural network dynamics.

神经网络时序复杂性无标度网络动力学分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。