用自监督学习模拟猴子视觉皮层方向图谱的自发形成
Self-organized MT Direction Maps Emerge from Spatiotemporal Contrastive Optimization

- 通过时空对比学习训练3D ResNet,模拟视觉皮层方向选择性
- 模型自发产生类脑方向图谱与螺旋结构,匹配真实神经数据
- 揭示方向选择性由任务驱动力与空间正则化权衡决定,适合神经科学与深度学习交叉研究者
灵长类视觉皮层的空间与功能组织是神经科学中的基本问题。尽管近期的拓扑深度人工神经网络(TDANN)成功建模了腹侧流的空间组织,但背侧流特有的拓扑结构(如中颞区MT的运动方向选择性图谱)的计算起源仍不明确。本文提出一种时空TDANN,通过在自然视频上使用动量对比(MoCo)自监督范式并结合生物启发的空间损失训练3D ResNet,展示了类脑方向图谱与拓扑螺旋结构的自发形成。关键发现:MT的调谐特性(强方向选择性伴随残余轴向成分)源于任务驱动判别压力与空间正则化的严格权衡。模型表示在方向选择性指数、圆方差和螺旋密度等指标上,与在体猕猴MT生理基线定量吻合。这些结果统一了腹侧与背侧流的计算起源,确立了皮层自组织的一般机制。
原文摘要 · Abstract (English)
The spatial and functional organization of the primate visual cortex is a fundamental problem in neuroscience. While recent computational frameworks like the Topographic Deep Artificial Neural Network (TDANN) have successfully modeled spatial organization in the ventral stream, the computational origins of the dorsal stream's distinct topographies, such as direction-selective maps in the middle temporal (MT) area, remain largely unresolved. In this work, we present a spatiotemporal TDANN to investigate whether MT topography is governed by the same universal principles. By training a 3D ResNet on naturalistic videos via a Momentum Contrast (MoCo) self-supervised paradigm alongside a biologically inspired spatial loss, we demonstrate the spontaneous emergence of brain-like direction maps and topological pinwheel structures. Crucially, we reveal that MT tuning properties, characterized by strong direction selectivity paired with a residual axial component, arise from a strict optimization trade-off between task-driven discriminative pressure and spatial regularization. The model's representations quantitatively match in vivo macaque MT physiological baselines, including direction selectivity index, circular variance, and pinwheel density. These findings unify the computational origins of the ventral and dorsal streams, establishing a general mechanism for cortical self-organization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。