arXiv:2502.20408q-bio.NCcs.AI2025-02被引 4

发现大模型中类似大脑的功能网络,关键网络影响模型性能。

Brain-Inspired Exploration of Functional Networks and Key Neurons in Large Language Models

  • 借鉴脑功能网络方法,识别大模型中的功能性神经网络。
  • 抑制关键功能网络会严重降低模型能力,增强则可提升性能。
  • 适合对模型机制、神经网络结构感兴趣的读者。

近年来,大语言模型(LLMs)在自然语言处理领域的快速发展引发了研究者对其工作机制与功能特性的广泛关注。尽管先前研究尝试通过识别和解释特定神经元来解析LLM功能,但大多仅关注单个神经元的贡献,忽略了人类大脑功能依赖于复杂交互网络的事实。受神经科学中功能脑网络(FBNs)研究的启发,本文采用类似FBN分析的方法,探索大语言模型中的“功能网络”。实验结果表明,与人类大脑类似,大语言模型在运行过程中频繁出现某些可复现的功能网络。进一步研究发现,这些功能网络对模型性能至关重要:抑制关键功能网络会显著削弱模型能力;而增强其中神经元的活动,则可提升模型整体表现或特定任务表现。这表明这些功能网络与特定任务或模型整体性能密切相关。代码已开源:https://github.com/WhatAboutMyStar/LLM_ACTIVATION。

原文摘要 · Abstract (English)

In recent years, the rapid advancement of large language models (LLMs) in natural language processing has sparked significant interest among researchers to understand their mechanisms and functional characteristics. Although prior studies have attempted to explain LLM functionalities by identifying and interpreting specific neurons, these efforts mostly focus on individual neuron contributions, neglecting the fact that human brain functions are realized through intricate interaction networks. Inspired by research on functional brain networks (FBNs) in the field of neuroscience, we utilize similar methodologies estabilished in FBN analysis to explore the "functional networks" within LLMs in this study. Experimental results highlight that, much like the human brain, LLMs exhibit certain functional networks that recur frequently during their operation. Further investigation reveals that these functional networks are indispensable for LLM performance. Inhibiting key functional networks severely impairs the model's capabilities. Conversely, amplifying the activity of neurons within these networks can enhance either the model's overall performance or its performance on specific tasks. This suggests that these functional networks are strongly associated with either specific tasks or the overall performance of the LLM. Code is available at https://github.com/WhatAboutMyStar/LLM_ACTIVATION.

大模型机制功能网络神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。