用大模型生成情感标签,连续解码大脑情绪动态变化。
Decoding Naturalistic Emotion Dynamics from the Brain: An LLM-Enhanced Regression Framework

- 以多目标回归框架追踪情绪的连续演变轨迹。
- 基于动态功能连接的模型表现优于静态脑区信号,准确率显著提升。
- 结合图论XAI技术,揭示情绪特异的脑网络拓扑结构。
从神经信号中解码情绪传统上被当作基于稳定刺激的离散单标签分类任务,忽略了人类情感的连续性、流动性与共现性。本研究重新定义情绪解码,采用多目标回归框架,追踪多个重叠情绪维度随时间的连续轨迹。借助大语言模型(LLM)的强泛化能力,我们从自然语境音频叙事《爱丽丝梦游仙境》中提取细粒度连续情感谱,作为人脑fMRI数据集中主观情绪的可扩展代理。不同于标准分类或剔除网络动态的质询分析范式,我们使用正则化与核方法机器学习算法作为连续估计器,追踪宏观神经状态变化的幅度。结果表明,基于动态功能连接(DFC)时间快照的模型显著优于静态区域-兴趣点(ROI)振幅表示,能有效捕捉快速变化叙事输入下的连续情绪轨迹。此外,通过实施图论解释性AI(XAI)技术,我们解析出具有高度可解释性的、情绪特异的拓扑配置。综合来看,这些结果凸显了LLM自动化标注在情感神经科学中的价值,并为心理建构主义框架提供有力实证支持,表明动态分布式网络交互比严格定位主义解释更具优势。
原文摘要 · Abstract (English)
Decoding emotional states from neural signals has been typically framed as a discrete, single-label classification task based on emotionally stable stimuli, a formulation that oversimplifies the continuous, fluid, and co-occurring nature of human affect. This study reconceptualizes emotion decoding by adopting a multi-target regression framework to track multiple overlapping emotional dimensions as continuous trajectories over time. Leveraging the robust generalization capabilities of Large Language Models (LLMs), we extracted fine-grained, continuous sentiment profiles from a naturalistic auditory narrative, Alice in Wonderland, to serve as scalable proxies for subjective affect from human fMRI dataset. Departing from standard classification paradigms or mass-univariate subtractive contrasts that filter out network dynamics, we leverage regularized and kernel-based machine learning algorithms as continuous estimators to track the magnitude of macroscale neural state variations. We demonstrate that models trained on temporal snapshots of Dynamic Functional Connectivity (DFC) significantly outperform static region-of-interest (ROI) amplitude representations, effectively capturing continuous emotional trajectories under rapidly fluctuating narrative input. Furthermore, by implementing graph-theoretical Explainable AI (XAI) techniques, we deconstruct the underlying predictive features to reveal highly interpretable, emotion-specific topological configurations. Collectively, these results highlight the utility of LLM-automated annotation in affective neuroscience and provide compelling empirical evidence for psychological constructionist frameworks, demonstrating that dynamic, distributed network interactions offer superior explanatory power over strictly locationist accounts of emotion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。