用小鼠视觉皮层启发深度模型,提升跨域泛化能力。
Mice to Machines: Neural Representations from Visual Cortex for Domain Generalization
- 通过神经表征学习,发现小鼠皮层与深度模型在整体和单细胞层面的映射相似。
- 引入神经响应归一化层后,模型在域泛化任务中抗数据漂移能力显著增强。
- 为脑启发AI设计提供新框架,适合关注生物可解释性与鲁棒性的研究者。
小鼠是系统神经科学中最常研究的动物模型之一。理解小鼠视觉皮层对多样化自然场景刺激产生的泛化模式与神经表征,是计算视觉领域的关键挑战。近年来,灵长类视觉皮层与分层深度神经网络之间被发现存在显著相似性,但其在小鼠视觉理解中的有效性有限。本研究探讨了小鼠视觉皮层与深度学习模型在物体分类任务中的功能对齐。首先提出一种泛化表征学习策略,在自上而下(群体水平)和自下而上(单细胞水平)两种情景下均揭示了小鼠皮层与高性能深度模型间惊人的映射相似性。随后,通过引入受视觉皮层兴奋与抑制神经元激活特征启发的神经响应归一化(NeuRN)层,进一步增强了两系统间的表征相似性。为验证NeuRN在真实任务中的性能,将其嵌入深度学习模型,结果在域泛化任务中显著提升了模型对数据偏移的鲁棒性。本工作提出了一种比较小鼠视觉皮层与深度学习模型功能架构的新范式,表明这些模型不仅是研究小鼠神经表征的有力工具,还可通过借鉴其结构提升真实世界任务表现。
原文摘要 · Abstract (English)
The mouse is one of the most studied animal models in the field of systems neuroscience. Understanding the generalized patterns and decoding the neural representations that are evoked by the diverse range of natural scene stimuli in the mouse visual cortex is one of the key quests in computational vision. In recent years, significant parallels have been drawn between the primate visual cortex and hierarchical deep neural networks. However, their generalized efficacy in understanding mouse vision has been limited. In this study, we investigate the functional alignment between the mouse visual cortex and deep learning models for object classification tasks. We first introduce a generalized representational learning strategy that uncovers a striking resemblance between the functional mapping of the mouse visual cortex and high-performing deep learning models on both top-down (population-level) and bottom-up (single cell-level) scenarios. Next, this representational similarity across the two systems is further enhanced by the addition of Neural Response Normalization (NeuRN) layer, inspired by the activation profile of excitatory and inhibitory neurons in the visual cortex. To test the performance effect of NeuRN on real-world tasks, we integrate it into deep learning models and observe significant improvements in their robustness against data shifts in domain generalization tasks. Our work proposes a novel framework for comparing the functional architecture of the mouse visual cortex with deep learning models. Our findings carry broad implications for the development of advanced AI models that draw inspiration from the mouse visual cortex, suggesting that these models serve as valuable tools for studying the neural representations of the mouse visual cortex and, as a result, enhancing their performance on real-world tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。