用短片段训练大模型,让疾病编码有据可查且成本更低
From Documents to Spans: Scalable Supervision for Evidence-Based ICD Coding with LLMs
- 以局部文本片段为中心进行训练,学习代码对应的证据模式
- 在相同模型下,准确率提升8.2点,训练成本仅为常规方法的1/5
- 生成可审计的逐项证据,适合医疗编码与合规审查场景
国际疾病分类(ICD)编码将诊断信息映射到标准代码,对医保结算和临床分析至关重要。可靠编码需每个预测代码都有明确文本证据支持。但现有公开数据集仅提供代码标签,缺乏证据标注,制约了模型学习能力。本文提出,无需对整篇文档做密集标注,模型可通过少量标注文档中的局部片段,学习代码相关的证据模式,并将其迁移到全文档级编码任务。为此,我们设计了以片段为中心的学习(SCL)框架:利用少量标注文档监督证据识别、聚合与代码分配,同时使用大量轻量级合成片段强化片段级推理。由于片段标注紧凑,可规模化扩展。在相同的Llama3.1-8B模型上,该方法实现宏平均F1提升8.2点,训练成本仅为标准微调的20%,且为每个预测代码提供可追溯的显式证据,支持人工审核与修正。
原文摘要 · Abstract (English)
International Classification of Diseases (ICD) coding assigns diagnosis codes to clinical documents and is essential for healthcare billing and clinical analysis. Reliable coding requires that each predicted code be supported by explicit textual evidence. However, existing public datasets provide only code labels, without evidence annotations, limiting models' ability to learn evidence-grounded predictions. In this work, we argue that dense, document-level evidence annotation is not always necessary for learning evidence-based coding. Instead, models can learn code-specific evidence patterns from local spans and use these patterns to support document-level evidence-based coding. Based on this insight, we propose Span-Centric Learning (SCL), a training framework that strengthens LLMs' coding ability at the span level and transfers this capability to full clinical documents. Specifically, we use a small set of annotated documents to supervise evidence recognition, aggregation, and code assignment, while leveraging a large collection of lightweight evidence spans to reinforce span-level reasoning. Due to their compactness, span annotations are scalable and can be further augmented through synthesis. Under the same Llama3.1-8B backbone, our approach achieves an 8.2-point improvement in macro-F1 at only 20% of the training cost of standard SFT, and provides explicit supporting evidence for each predicted code, enabling human auditing and revision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。