arXiv:2505.18169cs.LGeess.SP2025-05被引 1

用物理模型同时预测情绪与皮肤电反应,结果更准且可解释。

Interpretable Multi-Task PINN for Emotion Recognition and EDA Prediction

  • 联合情绪分类与皮肤电活动预测,引入生理动力学方程约束。
  • 皮肤电预测误差仅0.0362,情绪识别F1达94.08%,优于基线模型。
  • 参数具生理意义,适合医疗健康与人机交互场景的可解释系统。

利用可穿戴传感器理解与预测人类情绪及生理状态,在压力监测、心理健康评估和情感计算中具有重要意义。本研究提出一种新型多任务物理信息神经网络(Multi-Task PINN),基于公开的WESAD数据集,同时完成皮肤电活动(EDA)预测与情绪分类。模型融合心理自评特征(PANAS和SAM)与描述EDA动态的物理启发微分方程,通过定制损失函数施加生物物理约束,该损失包含EDA回归、情绪分类及物理残差项。网络支持双输出,采用统一多任务框架训练。5折交叉验证结果显示,平均EDA RMSE为0.0362,皮尔逊相关系数达0.9919,情绪分类F1得分为94.08%。性能优于支持向量回归(SVR)、XGBoost等经典模型以及仅预测情绪或仅预测EDA的消融模型。此外,学习到的物理参数(如衰减率alpha_0、情绪敏感度beta、时间缩放gamma)具有可解释性且跨折稳定,符合人体生理学已知规律。该工作首次将多任务PINN框架应用于可穿戴情绪识别,兼具更高性能、更强泛化能力与模型透明性,为未来医疗健康与人机交互中的可解释多模态应用奠定基础。

原文摘要 · Abstract (English)

Understanding and predicting human emotional and physiological states using wearable sensors has important applications in stress monitoring, mental health assessment, and affective computing. This study presents a novel Multi-Task Physics-Informed Neural Network (PINN) that performs Electrodermal Activity (EDA) prediction and emotion classification simultaneously, using the publicly available WESAD dataset. The model integrates psychological self-report features (PANAS and SAM) with a physics-inspired differential equation representing EDA dynamics, enforcing biophysically grounded constraints through a custom loss function. This loss combines EDA regression, emotion classification, and a physics residual term for improved interpretability. The architecture supports dual outputs for both tasks and is trained under a unified multi-task framework. Evaluated using 5-fold cross-validation, the model achieves an average EDA RMSE of 0.0362, Pearson correlation of 0.9919, and F1-score of 94.08 percent. These results outperform classical models such as SVR and XGBoost, as well as ablated variants like emotion-only and EDA-only models. In addition, the learned physical parameters including decay rate (alpha_0), emotional sensitivity (beta), and time scaling (gamma) are interpretable and stable across folds, aligning with known principles of human physiology. This work is the first to introduce a multi-task PINN framework for wearable emotion recognition, offering improved performance, generalizability, and model transparency. The proposed system provides a foundation for future interpretable and multimodal applications in healthcare and human-computer interaction.

情绪识别可解释模型多任务学习生理信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。