arXiv:2501.05755cs.SDcs.LG2025-01中稿 · publication in IEE…被引 14

用手机对话检测早期认知衰退,准确率达87.3%

CognoSpeak: an automatic, remote assessment of early cognitive decline in real-world conversational speech

  • 通过虚拟助手在真实场景中收集语音与多模态数据
  • 用DistilBERT模型识别认知障碍者,F1达0.873
  • 适合居家远程筛查,比传统评估更轻松低成本

认知衰退的早期迹象常体现在对话言语中,及时识别对防治神经退行性疾病至关重要。临床检测成本高、耗时长,现有自动分析系统多基于小规模数据集,缺乏详细元数据和人口统计信息。本文提出CognoSpeak及其数据采集方案:通过虚拟助手在移动端或网页端提问记忆相关问题,并执行语言流畅性、语义流畅性及图片描述等标准认知任务,同时收集音频、视频及来自初级/二级医疗、记忆门诊和家庭环境的丰富元数据。本研究基于126名受试者的语音转录结果,测试多种经典分类器及大语言模型。结果显示,使用DistilBERT模型结合记忆回答、流畅性任务和饼干盗窃图片描述,可实现0.873的F1分数,有效区分认知障碍(痴呆及轻度认知障碍)人群与健康志愿者。CognoSpeak是一种自动、远程、低成本、可重复、非侵入且压力更小的新型认知评估方式。

原文摘要 · Abstract (English)

The early signs of cognitive decline are often noticeable in conversational speech, and identifying those signs is crucial in dealing with later and more serious stages of neurodegenerative diseases. Clinical detection is costly and time-consuming and although there has been recent progress in the automatic detection of speech-based cues, those systems are trained on relatively small databases, lacking detailed metadata and demographic information. This paper presents CognoSpeak and its associated data collection efforts. CognoSpeak asks memory-probing long and short-term questions and administers standard cognitive tasks such as verbal and semantic fluency and picture description using a virtual agent on a mobile or web platform. In addition, it collects multimodal data such as audio and video along with a rich set of metadata from primary and secondary care, memory clinics and remote settings like people's homes. Here, we present results from 126 subjects whose audio was manually transcribed. Several classic classifiers, as well as large language model-based classifiers, have been investigated and evaluated across the different types of prompts. We demonstrate a high level of performance; in particular, we achieved an F1-score of 0.873 using a DistilBERT model to discriminate people with cognitive impairment (dementia and people with mild cognitive impairment (MCI)) from healthy volunteers using the memory responses, fluency tasks and cookie theft picture description. CognoSpeak is an automatic, remote, low-cost, repeatable, non-invasive and less stressful alternative to existing clinical cognitive assessments.

认知评估语音分析远程检测AI筛查

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。