用语音数据自动评估居家患者健康状态,提升远程护理效率。
Hearing Health in Home Healthcare: Leveraging LLMs for Illness Scoring and ALMs for Vocal Biomarker Extraction
- 用大语言模型融合病历文本与生命体征生成综合健康评分。
- 通过音频语言模型从语音中提取可读的健康相关声学特征。
- 首次证明语音分析能反映真实临床状况,适合医疗监控场景。
居家医疗需求增长推动对自动化健康评估工具的需求。本研究利用真实居家护理访问数据中的多源信息,通过大语言模型(LLMs)整合非结构化语音转录的主观、客观、评估与计划(SOAP)记录及结构化生命体征,生成反映患者整体健康状况的综合疾病评分。该紧凑表示支持跨访视健康对比与后续分析。随后,设计多阶段预处理流程,从居家录音中提取目标说话人短语音段,并采用音频语言模型(ALM)生成语音生物标志物的自然语言描述,分析其与健康状态的关联。实验表明,商业与开源LLMs在估计疾病评分上表现良好,且与临床结果高度一致;其中SOAP记录远比生命体征提供更多信息。基于疾病评分,首次验证了ALM能从居家录音中识别与健康相关的声学模式,并以人类可读形式呈现。这些成果展示了LLMs和ALMs在挖掘居家多源数据方面的潜力,有助于实现更精准的患者监测与护理支持。
原文摘要 · Abstract (English)
The growing demand for home healthcare calls for tools that can support care delivery. In this study, we explore automatic health assessment from voice using real-world home care visit data, leveraging the diverse patient information it contains. First, we utilize Large Language Models (LLMs) to integrate Subjective, Objective, Assessment, and Plan (SOAP) notes derived from unstructured audio transcripts and structured vital signs into a holistic illness score that reflects a patient's overall health. This compact representation facilitates cross-visit health status comparisons and downstream analysis. Next, we design a multi-stage preprocessing pipeline to extract short speech segments from target speakers in home care recordings for acoustic analysis. We then employ an Audio Language Model (ALM) to produce plain-language descriptions of vocal biomarkers and examine their association with individuals' health status. Our experimental results benchmark both commercial and open-source LLMs in estimating illness scores, demonstrating their alignment with actual clinical outcomes, and revealing that SOAP notes are substantially more informative than vital signs. Building on the illness scores, we provide the first evidence that ALMs can identify health-related acoustic patterns from home care recordings and present them in a human-readable form. Together, these findings highlight the potential of LLMs and ALMs to harness heterogeneous in-home visit data for better patient monitoring and care.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。