发现大语言模型具备类脑功能组织结构,随能力提升更接近人脑。
Brain-like Functional Organization within Large Language Models
- 用人工神经元活动模式匹配人脑功能网络,建立直接关联。
- BERT和Llama系列模型均表现出类脑功能组织,且能力越强越协调。
- 为构建类脑通用人工智能提供新思路,适合认知科学与AI交叉研究者。
人类大脑长期启发人工智能研究。近期神经影像学研究表明,人工神经网络(ANN)的计算表征与人脑对刺激的神经反应高度一致,暗示其可能采用类脑信息处理策略。尽管这种对齐已在视觉、听觉和语言等模态中被观察到,但多数研究聚焦于人工神经元(ANs)群体行为,未深入探索个体神经元的功能组织如何促成此类类脑过程。本研究通过将人工神经元子群与人脑功能网络(FBNs)直接耦合,填补这一空白。具体而言,我们从大语言模型(LLMs)中提取人工神经元的时间响应代表性模式,并作为固定回归因子,构建体素级编码模型以预测功能性磁共振成像(fMRI)记录的脑活动。该框架使人工神经元子群与FBNs得以对应,从而揭示了LLMs中的类脑功能组织。结果表明,包括BERT和Llama 1-3在内的大语言模型展现出类脑功能架构,其人工神经元子群映射至已知的典型功能网络。值得注意的是,随着模型能力提升,其类脑功能组织逐渐优化,实现计算行为多样性与功能特异性一致性的更好平衡。此项研究首次系统探索了大语言模型中的类脑功能组织,为基于人脑原理发展通用人工智能(AGI)提供了全新洞见。
原文摘要 · Abstract (English)
The human brain has long inspired the pursuit of artificial intelligence (AI). Recently, neuroimaging studies provide compelling evidence of alignment between the computational representation of artificial neural networks (ANNs) and the neural responses of the human brain to stimuli, suggesting that ANNs may employ brain-like information processing strategies. While such alignment has been observed across sensory modalities--visual, auditory, and linguistic--much of the focus has been on the behaviors of artificial neurons (ANs) at the population level, leaving the functional organization of individual ANs that facilitates such brain-like processes largely unexplored. In this study, we bridge this gap by directly coupling sub-groups of artificial neurons with functional brain networks (FBNs), the foundational organizational structure of the human brain. Specifically, we extract representative patterns from temporal responses of ANs in large language models (LLMs), and use them as fixed regressors to construct voxel-wise encoding models to predict brain activity recorded by functional magnetic resonance imaging (fMRI). This framework links the AN sub-groups to FBNs, enabling the delineation of brain-like functional organization within LLMs. Our findings reveal that LLMs (BERT and Llama 1-3) exhibit brain-like functional architecture, with sub-groups of artificial neurons mirroring the organizational patterns of well-established FBNs. Notably, the brain-like functional organization of LLMs evolves with the increased sophistication and capability, achieving an improved balance between the diversity of computational behaviors and the consistency of functional specializations. This research represents the first exploration of brain-like functional organization within LLMs, offering novel insights to inform the development of artificial general intelligence (AGI) with human brain principles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。