arXiv:2502.10108cs.LGq-bio.NC2025-02被引 4

通过说话分析检测阿尔茨海默病,还能解释原因

NeuroXVocal: Detection and Explanation of Alzheimer's Disease through Non-invasive Analysis of Picture-prompted Speech

  • 三路数据融合:声音、文字和语言嵌入,用自定义Transformer分类
  • 在公开数据集上准确率达95.77%,超越现有方法
  • 结合医学文献生成可解释的诊断理由,适合临床医生使用

阿尔茨海默病的早期非侵入式诊断仍是重大医疗挑战。本文提出NeuroXVocal,一个双组件系统,不仅可分类还可解释潜在阿尔茨海默病病例。分类模块(Neuro)处理三类数据流:捕捉语音模式与声学特征的声学特征、从语音转录中提取的文本特征,以及表示语言模式的预计算嵌入。这些数据流通过定制的Transformer架构融合,实现强健的跨模态交互。可解释性模块(XVocal)采用检索增强生成(RAG)方法,结合大语言模型与专用于阿尔茨海默病研究文献的知识库,能检索相关临床研究并生成基于证据、情境敏感的解释,说明患者语音中识别出的声学与语言标记。在IS2021 ADReSSo挑战赛基准数据集上,该系统达到95.77%的分类准确率,显著优于以往方法。可解释性部分通过医学专业人士完成的结构化问卷进行定性评估,验证其临床相关性。NeuroXVocal将高精度分类与基于文献的可解释性解释相结合,展现了其作为辅助临床诊断实用工具的潜力。

原文摘要 · Abstract (English)

The early diagnosis of Alzheimer's Disease (AD) through non invasive methods remains a significant healthcare challenge. We present NeuroXVocal, a novel dual-component system that not only classifies but also explains potential AD cases through speech analysis. The classification component (Neuro) processes three distinct data streams: acoustic features capturing speech patterns and voice characteristics, textual features extracted from speech transcriptions, and precomputed embeddings representing linguistic patterns. These streams are fused through a custom transformer-based architecture that enables robust cross-modal interactions. The explainability component (XVocal) implements a Retrieval-Augmented Generation (RAG) approach, leveraging Large Language Models combined with a domain-specific knowledge base of AD research literature. This architecture enables XVocal to retrieve relevant clinical studies and research findings to generate evidence-based context-sensitive explanations of the acoustic and linguistic markers identified in patient speech. Using the IS2021 ADReSSo Challenge benchmark dataset, our system achieved state-of-the-art performance with 95.77% accuracy in AD classification, significantly outperforming previous approaches. The explainability component was qualitatively evaluated using a structured questionnaire completed by medical professionals, validating its clinical relevance. NeuroXVocal's unique combination of high-accuracy classification and interpretable, literature-grounded explanations demonstrates its potential as a practical tool for supporting clinical AD diagnosis.

阿尔茨海默病语音分析可解释AI多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。