arXiv:2507.10005cs.LGcond-mat.stat-mech2025-07被引 1

研究神经网络结构对学习性能的影响,发现社区结构能提升性能但深度过深会反转效果。

Effects of relational graph modularity and depth on the learning performance of neural networks

  • 构建含社区结构的图模型,对比不同网络架构在图像分类中的表现。
  • 浅层网络中社区结构提升学习能力,但8层以上反而导致性能下降。
  • 结果提示生物神经网络结构可启发更高效的人工神经网络设计。

近年来,基于图的机器学习方法(如强化学习和图神经网络)受到广泛关注。尽管已有研究探讨神经网络图结构与其预测性能的关系,但多局限于特定模型网络,缺乏对介观尺度结构(如社区)的分析。本文通过引入具有异质度分布和社区结构的真实网络模型,系统研究了这些结构性质对图像分类任务性能的影响。实验使用随机网络、无标度网络,并与生物神经网络及其子集进行对比。结果表明,结构属性确实影响性能:具有紧密连接社区的网络在浅层时表现出更强的学习能力;然而,当网络扩展至八层时,该优势完全逆转。与生物神经网络的对比凸显了研究发现的现实意义,暗示了潜在的生物学启示,为网络科学与机器学习提供了新思路。

原文摘要 · Abstract (English)

In recent years, graph-based machine learning techniques, such as reinforcement learning and graph neural networks, have garnered significant attention. While some recent studies have started to explore the relationship between the graph structure of neural networks and their predictive performance, they often limit themselves to a narrow range of model networks, particularly lacking mesoscale structures such as communities. Our work advances this area by conducting a more comprehensive investigation, incorporating realistic network structures characterized by heterogeneous degree distributions and community structures, which are typical characteristics of many real networks. These community structures offer a nuanced perspective on network architecture. Our analysis employs model networks such as random and scale-free networks, alongside a comparison with a biological neural network and its subsets for more detailed analysis. We examine the impact of these structural attributes on the performance of image classification tasks. Our findings reveal that structural properties do affect performance to some extent. Specifically, networks featuring coherent, densely interconnected communities demonstrate enhanced learning capabilities. Crucially, we find that this advantage is depth-dependent: extending the architecture to eight layers reverses the effect entirely. This comparison with the biological neural network emphasizes the relevance of our findings to real-world structures, suggesting an intriguing connection worth further exploration. This study contributes meaningfully to network science and machine learning, providing insights that could inspire the design of more biologically informed neural networks.

图神经网络网络结构深度学习社区结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。