用语言模型自动匹配病历数据,减少人工工作量。
Leveraging Language Models for Automated Patient Record Linkage
- 用RoBERTa做分块,大幅减少候选配对数
- 微调后的Mistral-7B仅错6次,零样本中最佳为55错
- 适合需要高效整合医疗数据的研究者
医疗数据碎片化严重,本研究探索利用语言模型实现患者记录自动化关联。基于密苏里癌症登记与研究中心的真实数据,以概率关联为基线,采用RoBERTa模型进行分块任务的微调,利用句子嵌入生成候选对;在匹配任务中,测试多种语言模型在微调和零样本设置下的表现,并与真实标签对比。结果表明,微调后的分块模型将候选对数量减少了92%,召回率近乎完美;匹配任务中,微调版Mistral-7B表现最优,仅产生6个错误预测;零样本模型中,Mistral-Small-24B表现最佳,共55个错误。讨论指出,微调语言模型在分块与匹配中表现优异,但其分块效率仍低于混合规则-概率方法;而推理型模型如DeepSeek-R1因计算成本过高,难以用于大规模关联。结论显示,语言模型可显著提升患者记录关联效率,降低人工负担,支持疾病监测与研究。
原文摘要 · Abstract (English)
Objective: Healthcare data fragmentation presents a major challenge for linking patient data, necessitating robust record linkage to integrate patient records from diverse sources. This study investigates the feasibility of leveraging language models for automated patient record linkage, focusing on two key tasks: blocking and matching. Materials and Methods: We utilized real-world healthcare data from the Missouri Cancer Registry and Research Center, linking patient records from two independent sources using probabilistic linkage as a baseline. A transformer-based model, RoBERTa, was fine-tuned for blocking using sentence embeddings. For matching, several language models were experimented under fine-tuned and zero-shot settings, assessing their performance against ground truth labels. Results: The fine-tuned blocking model achieved a 92% reduction in the number of candidate pairs while maintaining near-perfect recall. In the matching task, fine-tuned Mistral-7B achieved the best performance with only 6 incorrect predictions. Among zero-shot models, Mistral-Small-24B performed best, with a total of 55 incorrect predictions. Discussion: Fine-tuned language models achieved strong performance in patient record blocking and matching with minimal errors. However, they remain less accurate and efficient than a hybrid rule-based and probabilistic approach for blocking. Additionally, reasoning models like DeepSeek-R1 are impractical for large-scale record linkage due to high computational costs. Conclusion: This study highlights the potential of language models for automating patient record linkage, offering improved efficiency by eliminating the manual efforts required to perform patient record linkage. Overall, language models offer a scalable solution that can enhance data integration, reduce manual effort, and support disease surveillance and research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。