用大模型提升法语电子病历中社会健康因素的记录完整度
Improving Social Determinants of Health Documentation in French EHRs Using Large Language Models
- 基于Flan-T5-Large模型从法语临床笔记提取13类社会健康因素
- 识别出95.8%患者至少一项社会健康因素,远超传统编码的2.8%
- 适用于医疗数据补全与健康不平等研究,尤其适合法语环境
社会健康因素(SDoH)显著影响疾病进展、治疗依从性和健康差异,但其在结构化电子健康记录(EHR)中的记录常不完整或缺失。本研究提出一种基于大语言模型(LLM)的方法,从法国南特大学医院的临床笔记中提取13类社会健康因素。我们使用标注的社会史部分训练了Flan-T5-Large模型,并在四个数据集上评估其性能,包括两个公开发布的数据集。模型在居住条件、婚姻状况、子女、职业、吸烟和饮酒等类别上表现优异(F1 > 0.80)。而在就业状态、住房、体力活动、收入和教育等数据少或表达多变的类别上表现较差。模型识别出95.8%的患者至少有一项社会健康因素,而结构化EHR中的ICD-10编码仅覆盖2.8%。错误分析表明性能受限于标注不一致、依赖英文分词器及仅在社会史文本上训练导致泛化能力下降。结果证明自然语言处理在非英语EHR系统中提升真实世界社会健康数据完整性方面具有有效性。
原文摘要 · Abstract (English)
Social determinants of health (SDoH) significantly influence health outcomes, shaping disease progression, treatment adherence, and health disparities. However, their documentation in structured electronic health records (EHRs) is often incomplete or missing. This study presents an approach based on large language models (LLMs) for extracting 13 SDoH categories from French clinical notes. We trained Flan-T5-Large on annotated social history sections from clinical notes at Nantes University Hospital, France. We evaluated the model at two levels: (i) identification of SDoH categories and associated values, and (ii) extraction of detailed SDoH with associated temporal and quantitative information. The model performance was assessed across four datasets, including two that we publicly release as open resources. The model achieved strong performance for identifying well-documented categories such as living condition, marital status, descendants, job, tobacco, and alcohol use (F1 score > 0.80). Performance was lower for categories with limited training data or highly variable expressions, such as employment status, housing, physical activity, income, and education. Our model identified 95.8% of patients with at least one SDoH, compared to 2.8% for ICD-10 codes from structured EHR data. Our error analysis showed that performance limitations were linked to annotation inconsistencies, reliance on English-centric tokenizer, and reduced generalizability due to the model being trained on social history sections only. These results demonstrate the effectiveness of NLP in improving the completeness of real-world SDoH data in a non-English EHR system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。