用大模型生成高质量伪标签,高效训练鲁棒的胸部X光报告分类器。
High-Fidelity Pseudo-label Generation by Large Language Models for Training Robust Radiology Report Classifiers
- 先用先进大模型生成高精度伪标签,再用DeBERTa小模型通过知识蒸馏学习。
- 在MIMIC-500数据集上达到0.9120的宏平均F1,显著优于传统方法。
- 特别擅长处理不确定表述,适合大规模医疗文本快速标注场景。
自动标注胸部X光报告对训练图像诊断模型、人群健康研究和临床决策支持至关重要。然而,自由文本报告中普遍存在变异性、复杂性以及否定和不确定性,给传统自然语言处理方法带来挑战。尽管大语言模型(LLMs)具备强大文本理解能力,但其直接用于大规模、高效标注受限于计算成本和速度。本文提出DeBERTa-RAD,一种结合先进LLM伪标签生成与高效DeBERTa知识蒸馏的两阶段框架。利用先进大模型为大量报告生成包含置信度状态的高质量伪标签,随后使用定制化知识蒸馏策略训练一个DeBERTa-Base模型。在专家标注的MIMIC-500基准上,DeBERTa-RAD实现0.9120的宏平均F1,显著优于规则系统、微调的Transformer模型及直接的大模型推理,同时保持适用于高吞吐量应用的实际推理速度。分析表明其在处理不确定发现方面表现尤为突出。本工作展示了通过战略性结合大模型能力与蒸馏训练的高效学生模型,克服数据标注瓶颈、实现高性能医疗文本处理的可行路径。
原文摘要 · Abstract (English)
Automated labeling of chest X-ray reports is essential for enabling downstream tasks such as training image-based diagnostic models, population health studies, and clinical decision support. However, the high variability, complexity, and prevalence of negation and uncertainty in these free-text reports pose significant challenges for traditional Natural Language Processing methods. While large language models (LLMs) demonstrate strong text understanding, their direct application for large-scale, efficient labeling is limited by computational cost and speed. This paper introduces DeBERTa-RAD, a novel two-stage framework that combines the power of state-of-the-art LLM pseudo-labeling with efficient DeBERTa-based knowledge distillation for accurate and fast chest X-ray report labeling. We leverage an advanced LLM to generate high-quality pseudo-labels, including certainty statuses, for a large corpus of reports. Subsequently, a DeBERTa-Base model is trained on this pseudo-labeled data using a tailored knowledge distillation strategy. Evaluated on the expert-annotated MIMIC-500 benchmark, DeBERTa-RAD achieves a state-of-the-art Macro F1 score of 0.9120, significantly outperforming established rule-based systems, fine-tuned transformer models, and direct LLM inference, while maintaining a practical inference speed suitable for high-throughput applications. Our analysis shows particular strength in handling uncertain findings. This work demonstrates a promising path to overcome data annotation bottlenecks and achieve high-performance medical text processing through the strategic combination of LLM capabilities and efficient student models trained via distillation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。