arXiv:2410.05450cs.CVcs.AI2024-10中稿 · publication in HEA…被引 2

用自拍照片分析孕妇抑郁焦虑,视觉语言模型表现更优

AI-Driven Early Mental Health Screening: Analyzing Selfies of Pregnant Women

  • 用预训练视觉语言模型分析自拍表情,无需额外标注
  • 在孕期抑郁焦虑筛查中达77.6%准确率
  • 适合资源有限场景下的心理健康早期筛查

重度抑郁症和焦虑症影响全球数百万人群,早期筛查对干预效果至关重要。人工智能可提升精神障碍筛查效率,实现早期干预。现有方法多依赖受控环境或专用设备,应用受限。本研究探索基于自拍图像的无处不在式抑郁-焦虑筛查,聚焦高危孕产妇群体。由于临床数据有限,采用两种策略:微调专为表情识别设计的卷积神经网络(CNN),以及使用视觉-语言模型(VLM)进行零样本表情分析。实验表明,所提VLM方法显著优于CNN,准确率达77.6%。尽管仍有提升空间,结果表明VLM在心理健康筛查中具有潜力。

原文摘要 · Abstract (English)

Major Depressive Disorder and anxiety disorders affect millions globally, contributing significantly to the burden of mental health issues. Early screening is crucial for effective intervention, as timely identification of mental health issues can significantly improve treatment outcomes. Artificial intelligence (AI) can be valuable for improving the screening of mental disorders, enabling early intervention and better treatment outcomes. AI-driven screening can leverage the analysis of multiple data sources, including facial features in digital images. However, existing methods often rely on controlled environments or specialized equipment, limiting their broad applicability. This study explores the potential of AI models for ubiquitous depression-anxiety screening given face-centric selfies. The investigation focuses on high-risk pregnant patients, a population that is particularly vulnerable to mental health issues. To cope with limited training data resulting from our clinical setup, pre-trained models were utilized in two different approaches: fine-tuning convolutional neural networks (CNNs) originally designed for facial expression recognition and employing vision-language models (VLMs) for zero-shot analysis of facial expressions. Experimental results indicate that the proposed VLM-based method significantly outperforms CNNs, achieving an accuracy of 77.6%. Although there is significant room for improvement, the results suggest that VLMs can be a promising approach for mental health screening.

AI筛查心理健康视觉语言模型自拍分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。