arXiv:2502.16106cs.CVcs.CY2025-02被引 2

用手机摄像头分析面部特征,实时检测社交焦虑。

AnxietyFaceTrack: A Smartphone-Based Non-Intrusive Approach for Detecting Social Anxiety Using Facial Features

  • 通过手机拍摄自然社交场景下人脸视频,提取眼动、头部位置等特征
  • 随机森林模型在多分类任务中达91.0%准确率,头部位置特征表现最佳
  • 无需特殊设备,适合日常使用,助力早期心理干预

社交焦虑障碍(SAD)是一种普遍的心理健康问题,但缺乏客观指标阻碍了及时发现与干预。以往研究多关注结构化场景(如演讲或面试)中的行为与非语言标志,难以还原真实、非预设的社会互动环境。在自然情境中识别非语言标志,是实现无感、持续监测的关键。为此,我们提出AnxietyFaceTrack,利用面部视频分析在非预设社交场景中检测焦虑状态。共91名参与者在陌生人群体中互动,其面部视频由低成本智能手机摄像头记录。分析包括眼动、头部位置、面部关键点和面部动作单元在内的多种面部特征,并结合自评问卷数据建立多分类(焦虑、中性、非焦虑)与二分类(如焦虑对中性)的标注基准。结果显示,基于前20%重要特征训练的随机森林分类器,在多分类任务中达到最高91.0%准确率,二分类平均准确率达92.33%。其中,头部位置与面部关键点分别在多分类中取得85.0%与88.0%准确率,二分类中分别为89.66%与91.0%。本研究提供了一种低成本、无侵入式解决方案,可嵌入日常智能手机,实现持续焦虑监测,为早期发现与干预开辟新路径。

原文摘要 · Abstract (English)

Social Anxiety Disorder (SAD) is a widespread mental health condition, yet its lack of objective markers hinders timely detection and intervention. While previous research has focused on behavioral and non-verbal markers of SAD in structured activities (e.g., speeches or interviews), these settings fail to replicate real-world, unstructured social interactions fully. Identifying non-verbal markers in naturalistic, unstaged environments is essential for developing ubiquitous and non-intrusive monitoring solutions. To address this gap, we present AnxietyFaceTrack, a study leveraging facial video analysis to detect anxiety in unstaged social settings. A cohort of 91 participants engaged in a social setting with unfamiliar individuals and their facial videos were recorded using a low-cost smartphone camera. We examined facial features, including eye movements, head position, facial landmarks, and facial action units, and used self-reported survey data to establish ground truth for multiclass (anxious, neutral, non-anxious) and binary (e.g., anxious vs. neutral) classifications. Our results demonstrate that a Random Forest classifier trained on the top 20% of features achieved the highest accuracy of 91.0% for multiclass classification and an average accuracy of 92.33% across binary classifications. Notably, head position and facial landmarks yielded the best performance for individual facial regions, achieving 85.0% and 88.0% accuracy, respectively, in multiclass classification, and 89.66% and 91.0% accuracy, respectively, across binary classifications. This study introduces a non-intrusive, cost-effective solution that can be seamlessly integrated into everyday smartphones for continuous anxiety monitoring, offering a promising pathway for early detection and intervention.

情绪检测手机监测非侵入式面部分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。