arXiv:2608.10442cs.CVcs.AI2026-08

无需分段处理,直接用完整视频检测压力状态。

FUSE: Frame-Unified Stress Estimation from Facial Video

  • 将视频帧按时间维度融合到通道维度,形成统一输入表示。
  • 在120秒完整视频上达到69.44%最高准确率,优于分段方法。
  • 适合需连续监测压力的实时场景,如心理健康评估。

从面部视频自动检测压力提供了一种非侵入式情绪监测的实用路径,但现有基于视频的方法通常将完整记录分解为短时窗进行分类,这引入了窗口长度、重叠度和聚合方式等额外选择,同时限制了对全记录时序信息的直接分析。本文提出FUSE(Frame-Unified Stress Estimation),一种无需时间分段或外部分割的面部视频压力检测框架,直接以完整录制作为单一输入。其核心思想是将时间维度折叠至空间表示的通道维度,生成高维统一输入,并采用统一的非对称注意力架构处理。在时间步长t=1时,FUSE保留完整的120秒视频(30帧/秒,共3,600帧)作为输入。在包含58名受试者的压力数据集上,采用分层受试者级协议评估了七种时间步长配置,从全帧输入到稀疏子采样。FUSE在t=15时取得最高测试准确率69.44%,全帧配置仍保持69.03%的竞争力。计算成本在12.48至348.78 GFLOPs间变化,体现了时序密度与效率间的权衡。结果表明,在此任务中无需时间分段,且可通过单一统一架构实现完整录制推理。

原文摘要 · Abstract (English)

Automatic stress detection from facial video offers a practical path to non-intrusive affect monitoring, yet existing video-based approaches commonly decompose full recordings into short temporal windows before classification. This design introduces additional choices regarding window length, overlap, and aggregation, while limiting direct analysis of temporal information across the entire recording. In this study, we present FUSE (Frame-Unified Stress Estimation), a facial-video stress detection framework that processes complete recordings as a single input without temporal windowing or external segmentation. The name reflects the defining operation of the method: rather than dividing a recording into short clips, all frames are fused into one unified two-dimensional representation from which the stress state is estimated. This unification is realized by folding the temporal dimension into the channel dimension of the spatial representation, and the resulting high-dimensional input is processed using a unified asymmetric-attention architecture. At a temporal stride of t = 1, FUSE retains the full 120-second recording as one input, corresponding to 3,600 frames at 30 fps. Experiments on a 58-subject stress dataset using a stratified subject-level protocol evaluate seven temporal-stride configurations, ranging from full-frame input to sparse subsampling. FUSE achieves the highest test accuracy of 69.44% at t = 15, while the full-frame configuration remains competitive at 69.03%. Across the stride range, computational cost varies from 12.48 to 348.78 GFLOPs, showing the trade-off between temporal density and efficiency. These results demonstrate that temporal windowing is not required for effective facial-video stress detection in this setting, and that complete-recording inference can be achieved within a single unified architecture.

压力检测视频分析统一建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。