arXiv:2506.19280cs.AIcs.HC2025-06

用用户行为和心率数据识别情绪,优化日程安排。

Emotion Detection on User Front-Facing App Interfaces for Enhanced Schedule Optimization: A Machine Learning Approach

  • 通过鼠标、键盘等操作分析情绪状态。
  • 基于行为的检测准确率达90%,优于心率方法。
  • 适合需要个性化日程优化的智能系统开发者。

人机交互已发展出情绪识别能力,为自适应与个性化体验带来新机遇。本文探讨将情绪检测集成至日历应用,使界面能动态响应用户情绪与压力水平,从而提升生产力与参与度。提出两种互补的情绪检测方法:一是基于生物信号的方法,利用从心电图(ECG)信号中提取的心率(HR)数据,通过长短期记忆网络(LSTM)与门控循环单元(GRU)神经网络预测情绪维度(效价、唤醒度、支配感);二是基于行为的方法,通过多种机器学习模型分析计算机活动,根据鼠标的移动、点击及击键模式等细粒度交互分类情绪。基于真实数据集的对比分析表明,尽管两种方法均有效,但基于计算机活动的方法在一致性与准确性上更优,尤其在鼠标相关交互上达到约90%的准确率;此外,在生物信号方法中,GRU模型优于LSTM,效价预测准确率达84.38%。

原文摘要 · Abstract (English)

Human-Computer Interaction (HCI) has evolved significantly to incorporate emotion recognition capabilities, creating unprecedented opportunities for adaptive and personalized user experiences. This paper explores the integration of emotion detection into calendar applications, enabling user interfaces to dynamically respond to users' emotional states and stress levels, thereby enhancing both productivity and engagement. We present and evaluate two complementary approaches to emotion detection: a biometric-based method utilizing heart rate (HR) data extracted from electrocardiogram (ECG) signals processed through Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) neural networks to predict the emotional dimensions of Valence, Arousal, and Dominance; and a behavioral method analyzing computer activity through multiple machine learning models to classify emotions based on fine-grained user interactions such as mouse movements, clicks, and keystroke patterns. Our comparative analysis, from real-world datasets, reveals that while both approaches demonstrate effectiveness, the computer activity-based method delivers superior consistency and accuracy, particularly for mouse-related interactions, which achieved approximately 90\% accuracy. Furthermore, GRU networks outperformed LSTM models in the biometric approach, with Valence prediction reaching 84.38\% accuracy.

情绪识别行为分析日程优化生物信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。