让语言模型在回忆时重拾情绪,提升决策能力
The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injection

- 通过情绪向量回注模拟人类情感标记机制
- 情绪回注使威胁判断更敏感,决策正确率提升至80%
- 适合研究大模型认知机制与具身智能的读者
当前语言模型存储事件事实但缺乏情感体验。借鉴杜马西奥理论,我们基于Gemma 3 1B-IT与Gemma Scope 2稀疏自编码器,在第22层识别出310个具有心理有效几何结构的情绪专属特征。在记忆过程中构建独特情绪向量,并在第7层上下文相似性触发下部分回注。测试四种条件:A(无记忆)、B(仅语义标签)、C(情绪回响)、BC(语义+回响)。结果显示,仅情绪回响使威胁判断梯度从0.56升至0.80(p=0.011);而结合知识后,决策准确率达80%(对比B组52%,z=+2.60,p<0.01),单独回响无效(C=22%,不显著)。情绪回响独立改变感受,但仅在融合知识时驱动行为,复现了杜马西奥核心发现:情绪放大知识,而非取代它。
原文摘要 · Abstract (English)
Current language model memory systems store what happened but not how it felt. This distinction -- between semantic memory (knowing about a past event) and episodic memory (re-experiencing it) -- was identified by Tulving as the difference between noetic and autonoetic consciousness. Damasio demonstrated that humans with intact knowledge but absent emotional markers exhibit impaired decision-making. We bridge this gap for language models. Using Gemma 3 1B-IT with pretrained Gemma Scope 2 sparse autoencoders, we identify 310 emotion-exclusive features at layer 22 with psychologically valid geometry. We construct distinctive-feature emotion vectors during experience and partially re-inject them during recall, triggered by context similarity at layer 7. We test four conditions paralleling Damasio's framework: A (no memory), B (semantic labels), C (emotion echo), and BC (semantic + echo). For emotional orientation, the echo alone steepens the threat-safety gradient: the regression slope of threat rating on contextual similarity is 0.80 for C vs 0.56 for A ($p$=0.011, permutation test). For decisions, the echo amplifies knowledge into action: BC=80% good choices vs B=52% ($z$=+2.60, $p$<0.01), while the echo alone has no effect (C=22%, n.s.). The echo changes how the model feels independently, but changes what it does only when combined with knowledge -- replicating Damasio's core finding. The echo amplifies knowledge. It does not replace it.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。