arXiv:2411.02036cs.CLcs.AI2024-11被引 11

用大模型分析对话,自动识别认知衰退迹象。

Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models

  • 从自由对话中提取理解力、注意力等高阶语言特征。
  • 结合大模型与专用机器学习模型,准确检测认知衰退。
  • 结果可解释,适合临床辅助筛查老年人认知问题。

认知与神经功能障碍极为普遍,但多数患者未被诊断或治疗,部分原因在于频繁筛查成本过高。通过高效智能系统早期发现疾病前兆并分析进展,有助于及时干预。本文提出利用大语言模型从老年人自由对话中提取特征,包括理解力下降、自我意识减弱、分心增加和记忆障碍等高阶认知特征。方法包括:(i) 数据预处理,(ii) 基于自然语言处理与提示工程的特征工程,(iii) 特征分析与筛选以优化性能,(iv) 分类并支持自动可解释性。同时探索如何利用最优特征提升ChatGPT直接预测能力。评估结果表明,融合特征提取与ChatGPT及专用机器学习模型的混合方法,在自由对话中检测认知衰退表现优异。本研究为开发低成本、非侵入式、快速的认知衰退检测与解释工具提供了可能。

原文摘要 · Abstract (English)

Cognitive and neurological impairments are very common, but only a small proportion of affected individuals are diagnosed and treated, partly because of the high costs associated with frequent screening. Detecting pre-illness stages and analyzing the progression of neurological disorders through effective and efficient intelligent systems can be beneficial for timely diagnosis and early intervention. We propose using Large Language Models to extract features from free dialogues to detect cognitive decline. These features comprise high-level reasoning content-independent features (such as comprehension, decreased awareness, increased distraction, and memory problems). Our solution comprises (i) preprocessing, (ii) feature engineering via Natural Language Processing techniques and prompt engineering, (iii) feature analysis and selection to optimize performance, and (iv) classification, supported by automatic explainability. We also explore how to improve Chatgpt's direct cognitive impairment prediction capabilities using the best features in our models. Evaluation metrics obtained endorse the effectiveness of a mixed approach combining feature extraction with Chatgpt and a specialized Machine Learning model to detect cognitive decline within free-form conversational dialogues with older adults. Ultimately, our work may facilitate the development of an inexpensive, non-invasive, and rapid means of detecting and explaining cognitive decline.

认知检测大模型应用可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。