arXiv:2512.07869q-bio.NCcs.AI2025-12中稿 · NeurIPS被引 1

通过分析神经网络中神经元的时序响应,揭示了模型各模块如何处理视觉信息。

Manifolds and Modules: How Function Develops in a Neural Foundation Model

  • 从时序响应角度解析每个'神经元',构建解码与编码流形来研究表征结构。
  • 递归模块通过分离不同时间模式的表征提升能力,读出模块则依赖大量专用特征图实现生物真实性。
  • 适合关注神经网络机制与脑科学关联的研究者,为理解模型内部运作提供新视角。

基础模型在拟合生物视觉系统方面表现出色,但其黑箱特性限制了对脑功能的理解。本文以生理学家视角审视一个最新的神经活动基础模型(Wang et al., 2025),基于神经元对参数化刺激的时序响应特性进行表征分析。通过构建解码流形分析不同刺激在神经活动空间中的表示,以及构建神经编码流形分析不同神经元在刺激-响应空间中的表示。发现模型的不同处理阶段(前馈编码器、递归模块和读出模块)在这些流形中展现出定性不同的表征结构:递归模块相较于编码器模块通过‘拉开’不同时间刺激模式的表示显著提升了能力;而读出模块虽达到生物真实性,却依赖大量专用特征图,而非生物学上可解释的机制。本研究揭示了该主流神经基础模型内部运作的内在机制,通过分析神经元联合时序响应模式,为理解其内部结构的生物学相关性提供了新思路。

原文摘要 · Abstract (English)

Foundation models have shown remarkable success in fitting biological visual systems; however, their black-box nature inherently limits their utility for understanding brain function. Here, we peek inside a SOTA foundation model of neural activity (Wang et al., 2025) as a physiologist might, characterizing each 'neuron' based on its temporal response properties to parametric stimuli. We analyze how different stimuli are represented in neural activity space by building decoding manifolds, and we analyze how different neurons are represented in stimulus-response space by building neural encoding manifolds. We find that the different processing stages of the model (i.e., the feedforward encoder, recurrent, and readout modules) each exhibit qualitatively different representational structures in these manifolds. The recurrent module shows a jump in capabilities over the encoder module by 'pushing apart' the representations of different temporal stimulus patterns; while the readout module achieves biological fidelity by using numerous specialized feature maps rather than biologically plausible mechanisms. Overall, we present this work as a study of the inner workings of a prominent neural foundation model, gaining insights into the biological relevance of its internals through the novel analysis of its neurons' joint temporal response patterns.

神经网络表征分析脑科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。