用多智能体模型自动识别语音日记中的妄想内容,提升精神疾病监测效率。
Automated Detection and Classification of Delusion-related Content in Naturalistic Audio Diaries Using Multi-Agent Language Models

- 设计多智能体协作框架,通过投票机制提取妄想语言与情绪行为线索。
- 微平均F1达0.872(妄想检测)和0.779(分类),显著降低误报率。
- 适合临床研究者与数字心理健康工具开发者使用。
自然情境下的语音独白为刻画精神疾病症状现象学及早期识别症状加重提供了可能。大语言模型(LLMs)无需大量训练数据即可实现自动化分析,仅需标注数据用于评估。本文提出一种新型多智能体LLM流程,用于从存在中度迫害性观念人群的自然语音日记转录文本中,细粒度、多标签提取暗示妄想信念、相关情绪反应及行为反应的内容。评估三个基础模型的集成效果表明,详细的诊断提示指令能有效减少妄想主题分类的假阳性,但会限制对情绪或行为反应的解释。对比多种多智能体仲裁框架发现,复杂对话辩论在临床模糊文本上易导致过早共识,降低准确率;而多数投票机制表现稳健(妄想检测微平均F1为0.872,分类为0.779)。本研究构建了可验证且可扩展的自动化检测与表征妄想内容的流水线。
原文摘要 · Abstract (English)
Speech monologues recorded in naturalistic settings provide opportunities to characterize mental illness phenomenology and detect symptom exacerbation. Large language models (LLMs) offer new possibilities for automating this process, as they require annotated data primarily for evaluation rather than training. In this paper, we present a novel automated, multi-agent LLM pipeline for the fine-grained, multi-label extraction of language suggestive of delusional beliefs, associated affective responses, and behavioral responses from transcripts of naturalistic audio diaries collected from people with moderate persecutory ideation. Evaluating an ensemble of three foundation models, we demonstrate that detailed diagnostic prompt instructions successfully reduce false positives for delusional theme classification, but also constrain the interpretation of affective or behavioral responses. Furthermore, comparing multi-agent adjudication frameworks shows that complex conversational debate between agents diminishes accuracy on clinically ambiguous text by inducing premature consensus. Instead, majority voting establishes robust performance (Micro F1 of 0.872 and 0.779 for delusion detection and classification respectively). This work provides a validated and scalable pipeline for the automated detection and characterization of content suggesting delusional beliefs in naturalistic speech.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。