用合成病历数据微调大模型,实现高精度医疗编码。
Training a Large Language Model for Medical Coding Using Privacy-Preserving Synthetic Clinical Data
- 用电子病历模板生成隐私保护的合成数据,微调Llama 3-70B模型。
- 微调后精确匹配F1超0.70,复杂病症编码性能依然出色。
- 无需真实病历即可安全训练编码模型,适合医疗信息化落地。
提升医疗编码的准确性和可靠性可减少医生负担,优化收入流程,使医疗机构更专注患者照护。然而,从临床记录自动标注ICD-10-CM和CPT代码仍面临记录异质性、编码规则复杂及长尾分布等挑战。尽管大语言模型被用于辅助编码任务,但通用基础模型未针对医疗编码训练,零样本编码效果差。本文研究是否可通过隐私保护的合成数据,将现代开源大模型适配至专家级医疗编码任务。我们基于电子病历模板与编码政策生成临床文本与标准代码对,对Llama 3-70B进行微调,并评估其在ICD-10-CM与CPT上的精确代码预测能力。零样本基线模型的精确匹配F1仅为0.18;微调后,精确匹配F1均超过0.70,绝对提升显著。尤其在需多步推理与组合编码的复杂类别(如晚期疾病与衰弱)中表现优异,且模型在医学理解任务上保持原有性能。结果表明,基于政策的合成数据能高效训练通用大模型实现精准编码,同时避免暴露受保护健康信息。该方法为安全、迭代式训练特定医疗编码代理提供了可行路径。
原文摘要 · Abstract (English)
Improving the accuracy and reliability of medical coding reduces clinician burnout and supports revenue cycle processes, freeing providers to focus more on patient care. However, automating the assignment of ICD-10-CM and CPT codes from clinical documentation remains a challenge due to heterogeneous records, nuanced coding guidelines, and long-tail distributions. Large language models have been proposed to help or automate specific medical coding tasks. However, foundation models are not explicitly trained for medical coding and zero-shot coding has yielded poor results. We investigate whether a modern open-weight foundation model can be adapted for an expert-level medical coding task using privacy-preserving synthetic training data derived from electronic health records. We fine-tune Llama 3-70B on pairs of clinical notes and gold codes generated from EHR-grounded templates and coding policies, then evaluate exact-code prediction for ICD-10-CM and CPT. A zero-shot baseline with the unadapted model achieved an F1 score of 0.18 for exact code match. After fine-tuning on the synthetic corpus, exact-match F1 exceeded 0.70, representing a large absolute gain across both code systems. Notably, performance remained high on complex categories that often require multi-step clinical reasoning and code composition, including Advanced Illness and Frailty classes, and the model retained its performance on medical comprehension tasks. These results indicate that synthetic, policy-aware data can efficiently teach a general-purpose large language model to support precise medical coding without exposing protected health information. The approach offers a practical path for training coding agents safely and iteratively on specific tasks that represent real-world populations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。