arXiv:2607.20819cs.CV2026-07中稿 · the 14th Internati…被引 5

用图注意力网络分析面部微表情,实现个性化压力识别

Explainable graph attention network for stress recognition (StressGAT) via differential action units

论文配图:Explainable graph attention network for stress recognition (StressGAT) via differential action units
图 1 · 摘自论文原文
  • 基于图注意力网络捕捉人脸动态,引入差分动作单元建模个体差异
  • 在58人数据集上达到88.62%准确率,支持跨被试验证
  • 可定位压力峰值时段,适合临床与个性化情绪监测场景

压力是具有显著个体差异的动态过程,传统RNN和CNN模型常忽略个体基线,且受限于序列瓶颈与固定网格结构,难以建模非线性时间演化。本文提出StressGAT,一种利用图建模关系归纳偏置的图注意力网络,通过差分动作单元(Differential Action Units)将个体反应归一化至中性基线,实现个性化压力识别。在包含58名参与者的多源压力诱导数据集上,采用被试独立的留一被试交叉验证(LOSO),模型达到88.62%的准确率。该框架还集成多重实例学习(MIL)注意力机制,可识别压力峰值阶段并揭示不同表达表型。同时兼顾预测精度与可解释性,为个性化情感监测提供可靠、透明的解决方案。

原文摘要 · Abstract (English)

Stress is a dynamic process characterized by significant individual variability in facial expression. Traditional architectures, such as Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs), often overlook person-specific baselines or lack the representational capacity to model the non-linear temporal progression of distress due to sequential bottlenecks and rigid grid-based constraints. Furthermore, many deep learning models lack the interpretability required for clinical deployment. This study introduces StressGAT, a Graph Attention Network that leverages the relational inductive bias of graph modeling to capture complex facial dynamics that indicate acute stress. By using Differential Action Units, the framework normalizes individual responses relative to neutral baselines to achieve personalized recognition. The proposed model achieves 88.62\% accuracy on a diverse stress-induction cohort (58 participants) using a subject-independent, Leave-One-Subject-Out (LOSO) cross-validation protocol. Beyond predictive accuracy, the architecture integrates a Multiple Instance Learning (MIL) attention mechanism to identify peak stress intervals and reveal distinct expressivity phenotypes. By simultaneously optimizing for accuracy and interpretability, this framework provides a robust, explainable solution for personalized affective monitoring.

情绪识别图神经网络可解释性压力检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。