arXiv:2505.20014cs.CL2025-05ACL被引 7

用高质量推理提升小模型精神疾病检测能力

Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation

  • 根据临床推理标准筛选大模型生成的解释
  • 小模型在精神疾病检测与解释上性能显著提升
  • 适合关注医疗AI可解释性的研究者

从社交媒体中检测心理健康问题并解释结果已受到广泛研究。研究表明,将临床症状信息融入模型可增强领域专业性,提升检测与解释性能。尽管大型语言模型(LLMs)在生成精神健康检测解释性理由方面表现有效,但其参数量大、计算成本高,实用性受限。推理蒸馏可将此能力迁移至小型语言模型(SLMs),但LLM生成的理由存在相关性与领域适配性不一致的问题。本文探究了理由质量对SLM在精神疾病检测中表现的影响,提出一种基于与专家临床推理对齐度选择理由的框架。实验表明,该质量导向方法显著提升了SLM在精神疾病检测与理由生成上的表现。本工作强调了理由质量的重要性,并为精神健康应用中的知识迁移提供了新思路。

原文摘要 · Abstract (English)

The detection of mental health problems from social media and the interpretation of these results have been extensively explored. Research has shown that incorporating clinical symptom information into a model enhances domain expertise, improving its detection and interpretation performance. While large language models (LLMs) are shown to be effective for generating explanatory rationales in mental health detection, their substantially large parameter size and high computational cost limit their practicality. Reasoning distillation transfers this ability to smaller language models (SLMs), but inconsistencies in the relevance and domain alignment of LLM-generated rationales pose a challenge. This paper investigates how rationale quality impacts SLM performance in mental health detection and explanation generation. We hypothesize that ensuring high-quality and domain-relevant rationales enhances the distillation. To this end, we propose a framework that selects rationales based on their alignment with expert clinical reasoning. Experiments show that our quality-focused approach significantly enhances SLM performance in both mental disorder detection and rationale generation. This work highlights the importance of rationale quality and offers an insightful framework for knowledge transfer in mental health applications.

精神健康可解释AI模型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。