arXiv:2604.17255cs.CL2026-04ACL

发现并调控大模型中情绪与修辞的神经元,实现精准控制表达风格。

Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering

论文配图:Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering
图 1 · 摘自论文原文
  • 通过多维筛选识别6类情绪和4种修辞的神经元
  • 提出自适应掩码方法,提升神经元功能验证可靠性
  • 可定向诱导非目标句子,增强情绪任务表现

准确理解与可控生成情绪和修辞对提升大语言模型推理能力至关重要。现有研究多依赖外部优化,缺乏对内部表征机制的深入探索,难以在神经元层面实现细粒度控制。少数关于神经元的研究仅关注情绪,忽视修辞神经元及其内在关联。传统神经元掩码还存在反直觉现象,导致神经元功能无法可靠验证。为此,我们系统研究了6类情绪与4种核心修辞手法的神经元表征机制及其内在联系。提出融合多维筛选的神经元识别框架,并设计包含动态过滤、衰减掩码与反馈优化的自适应掩码方法,实现神经元功能的可靠因果验证。通过神经元调控,成功实现非目标句的定向诱导,并借助修辞神经元提升情绪任务表现。在5个常用数据集上的实验验证了方法有效性,为大语言模型中情绪与修辞表达的细粒度控制提供了新范式。

原文摘要 · Abstract (English)

Accurate comprehension and controllable generation of emotion and rhetoric are pivotal for enhancing the reasoning capabilities of large language models (LLMs). Existing studies mostly rely on external optimizations, lacking in-depth exploration of internal representation mechanisms, thus failing to achieve fine-grained steering at the neuron level. A handful of works on neurons are confined to emotions, neglecting rhetoric neurons and their intrinsic connections. Traditional neuron masking also exhibits counterintuitive phenomena, making reliable verification of neuron functionality infeasible. To address these issues, we systematically investigate the neurons representation mechanisms and inherent associations of 6 emotion categories and 4 core rhetorical devices. We propose a neuron identification framework that integrates multi-dimensional screening, and design an adaptive masking method incorporating dynamic filtering, attenuation masking, and feedback optimization, enabling reliable causal validation of neuron functionality.Through neuron regulation, we achieve directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. Experiments on 5 commonly used datasets validate the effectiveness of our method, providing a novel paradigm for the fine-grained steering of emotion and rhetoric expressions in LLMs.

神经元分析情绪识别修辞生成可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。