arXiv:2509.15460q-bio.NCcs.AI2025-09被引 1

将大脑视觉皮层侧向连接机制融入CNN,提升模型性能与生物合理性。

Incorporating Visual Cortical Lateral Connection Properties into CNN: Recurrent Activation and Excitatory-Inhibitory Separation

  • 用权共享的循环结构模拟侧向连接,实现信息反馈。
  • 引入自定义损失函数分离兴奋与抑制权重,提升分类准确率。
  • 模型激活和连接特性更接近真实大脑,适合神经科学与深度学习交叉研究。

原始卷积神经网络(CNN)及其现代变体(如ResNet)虽受哺乳动物视觉系统启发,但仅包含传入连接(视网膜与外侧膝状体到视觉皮层)和长程投射(不同视觉皮层区域间的连接)。然而,在哺乳动物视觉系统中,各视觉皮层区域内还存在横向(水平)连接,这些连接大致对应于CNN特征图内的连接,而当前的CNN模型缺少这一关键架构。本文提出在标准CNN框架中建模此类横向连接,并测试其优势及涌现特性与生物视觉系统的关联性。重点考虑横向连接的两个核心特征:(1)循环激活;(2)兴奋与抑制连接的分离。我们证明使用权共享的循环CNN等价于横向连接,并提出一种定制损失函数以分离兴奋与抑制权重。加入这两项后,模型分类准确率提高,且其激活特性与连接模式表现出与生物学观察一致的性质。我们期望该方法使CNN更贴近其生物原型,并深化对视觉皮层计算原理的理解。

原文摘要 · Abstract (English)

The original Convolutional Neural Networks (CNNs) and their modern updates such as the ResNet are heavily inspired by the mammalian visual system. These models include afferent connections (retina and LGN to the visual cortex) and long-range projections (connections across different visual cortical areas). However, in the mammalian visual system, there are connections within each visual cortical area, known as lateral (or horizontal) connections. These would roughly correspond to connections within CNN feature maps, and this important architectural feature is missing in current CNN models. In this paper, we present how such lateral connections can be modeled within the standard CNN framework, and test its benefits and analyze its emergent properties in relation to the biological visual system. We will focus on two main architectural features of lateral connections: (1) recurrent activation and (2) separation of excitatory and inhibitory connections. We show that recurrent CNN using weight sharing is equivalent to lateral connections, and propose a custom loss function to separate excitatory and inhibitory weights. The addition of these two leads to increased classification accuracy, and importantly, the activation properties and connection properties of the resulting model show properties similar to those observed in the biological visual system. We expect our approach to help align CNN closer to its biological counterpart and better understand the principles of visual cortical computation.

CNN视觉皮层生物启发循环网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。