对比多种AI模型对精神科病历的诊断分类效果,发现调参比数据增强更重要。
Classification of Psychiatry Clinical Notes by Diagnosis: A Deep Learning and Machine Learning Approach
- 用机器学习与深度学习模型分类焦虑和适应障碍病历
- 调参后所有模型准确率均达96%,优于数据增强效果
- 适合关注医疗AI诊断效率的研究者和临床工程师
临床笔记的诊断分类在医疗领域尤其在精神健康方面至关重要。本研究比较了多种人工智能模型在将临床笔记分类为焦虑症和适应障碍两类诊断中的表现,涵盖传统机器学习方法(随机森林、支持向量机、K近邻、决策树、eXtreme Gradient Boost)以及深度学习模型(DistilBERT和SciBERT)。同时,采用三种过采样策略:无过采样、随机过采样和合成少数类过采样技术(SMOTE),评估其对模型性能的影响。还进行了超参数调优以优化准确率。结果表明,过采样技术整体上对模型性能影响较小,仅在基于BERT的模型中,SMOTE显示出积极效果。而超参数优化显著提升了各模型的准确率,增强了泛化能力。在机器学习模型中,决策树和eXtreme Gradient Boost均达到96%的最高准确率;深度学习模型中,DistilBERT和SciBERT也分别达到96%的准确率。研究强调了超参数调优在最大化模型性能中的关键作用,为精神健康领域AI辅助诊断工具的研究提供了重要参考。
原文摘要 · Abstract (English)
The classification of clinical notes into specific diagnostic categories is critical in healthcare, especially for mental health conditions like Anxiety and Adjustment Disorder. In this study, we compare the performance of various Artificial Intelligence models, including both traditional Machine Learning approaches (Random Forest, Support Vector Machine, K-nearest neighbors, Decision Tree, and eXtreme Gradient Boost) and Deep Learning models (DistilBERT and SciBERT), to classify clinical notes into these two diagnoses. Additionally, we implemented three oversampling strategies: No Oversampling, Random Oversampling, and Synthetic Minority Oversampling Technique (SMOTE), to assess their impact on model performance. Hyperparameter tuning was also applied to optimize model accuracy. Our results indicate that oversampling techniques had minimal impact on model performance overall. The only exception was SMOTE, which showed a positive effect specifically with BERT-based models. However, hyperparameter optimization significantly improved accuracy across the models, enhancing their ability to generalize and perform on the dataset. The Decision Tree and eXtreme Gradient Boost models achieved the highest accuracy among machine learning approaches, both reaching 96%, while the DistilBERT and SciBERT models also attained 96% accuracy in the deep learning category. These findings underscore the importance of hyperparameter tuning in maximizing model performance. This study contributes to the ongoing research on AI-assisted diagnostic tools in mental health by providing insights into the efficacy of different model architectures and data balancing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。