arXiv:2510.08858cs.LGcs.CV2025-10ICLR

用稀疏分解发现大脑视觉通路的差异,揭示神经网络对不同通路的建模程度。

Sparse components distinguish visual pathways & their alignment to neural networks

  • 通过稀疏分解识别三类视觉通路中的主导神经成分
  • 发现皮层中各通路对人脸、动作等有选择性响应,而背侧通路成分较难解释
  • 提出新对齐方法SCA,更精准衡量脑与模型间表征相似性

人脑高级视觉皮层的腹侧、背侧和外侧通路分别参与不同功能。尽管深度神经网络(DNNs)仅通过单一任务训练,却能较好模拟整个视觉系统,暗示其背后存在共同计算原理。为探究这一矛盾,我们采用新型稀疏分解方法,识别各通路中视觉表征的主导成分。结果与传统神经科学一致:腹侧通路包含对人脸、地点、身体、文字、食物敏感的成分;外侧通路对社会互动、隐含运动、手部动作敏感;背侧通路则包含部分难以解释的成分。在此基础上,我们提出稀疏成分对齐(SCA),一种衡量脑与机器表征对齐的新方法,能更好捕捉两类系统的潜在神经调谐。使用SCA发现,标准视觉DNNs与腹侧通路的对齐度高于背侧或外侧通路。SCA比传统群体级几何方法具有更高分辨率,可敏感反映系统内在神经调谐轴。

原文摘要 · Abstract (English)

The ventral, dorsal, and lateral streams in high-level human visual cortex are implicated in distinct functional processes. Yet, deep neural networks (DNNs) trained on a single task model the entire visual system surprisingly well, hinting at common computational principles across these pathways. To explore this inconsistency, we applied a novel sparse decomposition approach to identify the dominant components of visual representations within each stream. Consistent with traditional neuroscience research, we find a clear difference in component response profiles across the three visual streams -- identifying components selective for faces, places, bodies, text, and food in the ventral stream; social interactions, implied motion, and hand actions in the lateral stream; and some less interpretable components in the dorsal stream. Building on this, we introduce Sparse Component Alignment (SCA), a new method for measuring representational alignment between brains and machines that better captures the latent neural tuning of these two visual systems. Using SCA, we find that standard visual DNNs are more aligned with the ventral than either dorsal or lateral representations. SCA reveals these distinctions with greater resolution than conventional population-level geometry, offering a measure of representational alignment that is sensitive to a system's underlying axes of neural tuning.

神经科学视觉通路神经网络对齐稀疏分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。