arXiv:2606.13940cs.CL2026-06

后训练让大模型成为靠谱病历编码器,关键在针对性优化。

Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Coding

论文配图:Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Coding
图 1 · 摘自论文原文
  • 用监督微调和强化学习后训练,提升大模型编码能力。
  • 微调后编码准确率显著提高,强化学习进一步优化全分类召回。
  • 适合医疗AI研究者和临床数据工程师参考。

自动国际疾病分类(ICD)编码是医疗计费、流行病学和临床决策支持的核心任务。生成式大语言模型(LLMs)常被评价为编码能力弱,但这一结论多基于提示、检索、重排序或工具调用等推理阶段设置,缺乏对任务专用后训练的系统评估。本文开展一项受控实证研究,对比判别基线与生成式LLM编码器在提示、监督微调(SFT)和强化学习(GRPO)下的表现,采用统一协议与指标集。我们首次评估了基于强化学习的后训练在生成式LLM ICD编码中的应用。此外,提出PHI诊断课程,扩展GRPO以针对性改进漏码病例。结果表明,仅用提示会严重低估LLM潜力;SFT带来主要能力跃升,GRPO进一步提升代码集预测性能,PHI在宏观层面实现精准增益。这说明核心瓶颈并非生成式架构本身,而在于模型如何被适配与优化以实现全税目召回。代码、数据划分与检查点已开源。

原文摘要 · Abstract (English)

Automated International Classification of Diseases (ICD) coding is a core medical-coding task for billing, epidemiology, and clinical decision support. Generative large language models (LLMs) are often reported as weak medical coders, but this finding mainly comes from inference-time settings such as prompting, retrieval, reranking, or tool use, leaving the role of task-specific post-training underexplored. We present a controlled empirical study of post-training for generative ICD coding, comparing discriminative baselines with LLM coders across prompting, supervised fine-tuning, and reinforcement learning under a common protocol and metric set. To our knowledge, this is the first study to evaluate RL-based post-training for generative LLM coders in ICD coding. We further introduce PHI, a diagnostic curriculum that extends GRPO to refine missed-code cases. Our results show that prompting-only evaluation substantially underestimates the potential of LLMs for ICD coding. SFT provides the main capability jump, GRPO further improves code-set prediction beyond SFT, and PHI provides targeted gains on macro-level performance. These findings suggest that the main bottleneck is not the generative formulation alone, but how the model is adapted and optimized for full-taxonomy recall. We release our code, data splits, and checkpoints at https://github.com/AlexandreWANG915/LLM4ICD.

医疗编码大模型后训练ICD

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。