arXiv:2601.07877cs.LGcs.AI2026-01

首个可解释的脑电情绪分析大模型,让机器读懂大脑情绪信号。

E^2-LLM: Bridging Neural Signals and Interpretable Affective Analysis

  • 用可学习投影层连接脑电编码器与大语言模型,融合生理信号与语言推理。
  • 在7类情绪上分类准确率优秀,大模型版本零样本泛化能力更强。
  • 适合做脑机接口、心理计算等需要可解释情绪分析的研究者使用。

从脑电图(EEG)信号中识别情绪仍面临个体差异大、标注数据少及现有方法缺乏可解释性等问题。尽管多模态大语言模型(MLLM)在情绪分析方面取得进展,但尚未适配神经信号独特的时空特性。我们提出E^2-LLM(EEG-to-Emotion Large Language Model),首个面向可解释情绪分析的MLLM框架。该模型通过可学习投影层将预训练脑电编码器与基于Qwen的大语言模型结合,采用多阶段训练流程,包括情绪判别预训练、跨模态对齐和带思维链推理的指令微调。设计了涵盖基础情绪预测、多任务推理和零样本场景理解的综合评估协议。在包含七类情绪的数据集上的实验表明,E^2-LLM在情绪分类上表现优异,大模型版本展现出更高的可靠性及对复杂推理场景的卓越零样本泛化能力。本工作建立了生理信号与大语言模型推理能力融合的新范式,证实模型规模提升可同时增强识别准确率与可解释的情绪理解能力。

原文摘要 · Abstract (English)

Emotion recognition from electroencephalography (EEG) signals remains challenging due to high inter-subject variability, limited labeled data, and the lack of interpretable reasoning in existing approaches. While recent multimodal large language models (MLLMs) have advanced emotion analysis, they have not been adapted to handle the unique spatiotemporal characteristics of neural signals. We present E^2-LLM (EEG-to-Emotion Large Language Model), the first MLLM framework for interpretable emotion analysis from EEG. E^2-LLM integrates a pretrained EEG encoder with Qwen-based LLMs through learnable projection layers, employing a multi-stage training pipeline that encompasses emotion-discriminative pretraining, cross-modal alignment, and instruction tuning with chain-of-thought reasoning. We design a comprehensive evaluation protocol covering basic emotion prediction, multi-task reasoning, and zero-shot scenario understanding. Experiments on the dataset across seven emotion categories demonstrate that E^2-LLM achieves excellent performance on emotion classification, with larger variants showing enhanced reliability and superior zero-shot generalization to complex reasoning scenarios. Our work establishes a new paradigm combining physiological signals with LLM reasoning capabilities, showing that model scaling improves both recognition accuracy and interpretable emotional understanding in affective computing.

脑电分析情绪识别大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。