arXiv:2505.21324cs.CL2025-05被引 2

用大模型和传统机器学习结合,自动识别注意力缺陷多动障碍的言语特征。

Leveraging large language models and traditional machine learning ensembles for ADHD detection from narrative transcripts

  • 融合LLaMA3、RoBERTa和SVM三类模型,通过多数投票提升分类鲁棒性。
  • 在441个样本上达到0.71的F1分数,召回率优于单一模型。
  • 适合需要高敏感度筛查的临床文本分析场景。

尽管大型语言模型(LLMs)发展迅速,但其与传统监督学习方法在医学数据中的结合仍研究不足,尤其在精神科领域,叙述性数据常具有复杂的语义和上下文特征,更需多种模型互补。本文提出一种集成框架,基于叙事转录文本自动二分类注意缺陷/多动障碍(ADHD)诊断。该方法整合三个互补模型:捕获长程语义结构的开源大模型LLaMA3、在标注临床叙述上微调的RoBERTa,以及使用基于TF-IDF的词汇特征训练的支持向量机(SVM)。通过多数投票机制聚合结果以增强预测稳定性。数据集包含441个实例,其中352用于训练,89用于验证。实验表明,集成模型优于单个模型,达到0.71的F1分数(95%置信区间:[0.60–0.80])。相较于表现最佳的个体模型(SVM),集成模型提升了召回率,同时保持了有竞争力的精确率,说明其对ADHD相关语言线索具有强敏感性。结果表明,结合大模型语义丰富性与传统监督学习可解释性和模式识别能力的混合架构,在稳健且可泛化的精神科文本分类中具有潜力。

原文摘要 · Abstract (English)

Despite rapid advances in large language models (LLMs), their integration with traditional supervised machine learning (ML) techniques that have proven applicability to medical data remains underexplored. This is particularly true for psychiatric applications, where narrative data often exhibit nuanced linguistic and contextual complexity, and can benefit from the combination of multiple models with differing characteristics. In this study, we introduce an ensemble framework for automatically classifying Attention-Deficit/Hyperactivity Disorder (ADHD) diagnosis (binary) using narrative transcripts. Our approach integrates three complementary models: LLaMA3, an open-source LLM that captures long-range semantic structure; RoBERTa, a pre-trained transformer model fine-tuned on labeled clinical narratives; and a Support Vector Machine (SVM) classifier trained using TF-IDF-based lexical features. These models are aggregated through a majority voting mechanism to enhance predictive robustness. The dataset includes 441 instances, including 352 for training and 89 for validation. Empirical results show that the ensemble outperforms individual models, achieving an F$_1$ score of 0.71 (95\% CI: [0.60-0.80]). Compared to the best-performing individual model (SVM), the ensemble improved recall while maintaining competitive precision. This indicates the strong sensitivity of the ensemble in identifying ADHD-related linguistic cues. These findings demonstrate the promise of hybrid architectures that leverage the semantic richness of LLMs alongside the interpretability and pattern recognition capabilities of traditional supervised ML, offering a new direction for robust and generalizable psychiatric text classification.

ADHD检测文本分类大模型集成临床应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。