arXiv:2412.03796cs.AI2024-12被引 7

用大模型自动标注心理健康多病共现,提升诊断准确性。

Automated Multi-Label Annotation for Mental Health Illnesses Using Large Language Models

  • 用大模型将单标签数据转换为多标签标注,捕捉疾病共现复杂性。
  • 构建了包含6个数据集的SPAADE-DR多标签数据集,覆盖多种心理障碍。
  • 适合研究精神健康共病、社会媒体心理分析的学者使用。

心理健康障碍日益普遍且复杂,准确诊断与治疗面临挑战,尤其在理解共患病之间相互作用方面。现有社交媒体数据集通常仅标注单一疾病,限制了全面诊断分析的应用。本文提出一种新方法,通过清洗、采样、标注与合并数据,创建多功能多标签数据集。我们引入合成标注技术,将单标签数据转化为多标签注释,以捕捉重叠心理状况的复杂性。首先将两个单标签数据集合并为基础多标签数据集,实现对共病诊断的真实分析。随后设计并评估多种大语言模型(LLMs)的提示策略,从单标签预测到无限制提示,可检测任意存在的障碍。经过严格测试多个模型与提示组合,确定最优方案,并应用于来自RMHD的六个额外单标签数据集。最终生成SPAADE-DR,一个涵盖多种心理健康状况的稳健多标签数据集。研究表明,基于大模型的合成标注在推进社交媒体心理数据诊断方面具有变革潜力,为更精细、数据驱动的心理健康洞察铺平道路。

原文摘要 · Abstract (English)

The growing prevalence and complexity of mental health disorders present significant challenges for accurate diagnosis and treatment, particularly in understanding the interplay between co-occurring conditions. Mental health disorders, such as depression and Anxiety, often co-occur, yet current datasets derived from social media posts typically focus on single-disorder labels, limiting their utility in comprehensive diagnostic analyses. This paper addresses this critical gap by proposing a novel methodology for cleaning, sampling, labeling, and combining data to create versatile multi-label datasets. Our approach introduces a synthetic labeling technique to transform single-label datasets into multi-label annotations, capturing the complexity of overlapping mental health conditions. To achieve this, two single-label datasets are first merged into a foundational multi-label dataset, enabling realistic analyses of co-occurring diagnoses. We then design and evaluate various prompting strategies for large language models (LLMs), ranging from single-label predictions to unrestricted prompts capable of detecting any present disorders. After rigorously assessing multiple LLMs and prompt configurations, the optimal combinations are identified and applied to label six additional single-disorder datasets from RMHD. The result is SPAADE-DR, a robust, multi-label dataset encompassing diverse mental health conditions. This research demonstrates the transformative potential of LLM-driven synthetic labeling in advancing mental health diagnostics from social media data, paving the way for more nuanced, data-driven insights into mental health care.

心理健康多标签标注大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。