arXiv:2506.00200cs.CLcs.LG2025-06EMNLP被引 3

轻量模型比大模型更高效地结构化放射科报告,适合临床部署。

Structuring Radiology Reports: Challenging LLMs with Lightweight Models

  • 用小于300M参数的T5和BERT2BERT模型重构放射科报告
  • 轻量模型在人类标注测试集上超越所有提示调优的大模型
  • 计算成本仅为大模型的1/400,适合资源有限的医疗机构

放射科报告对临床决策至关重要,但格式不统一,影响可读性和机器学习应用。尽管大语言模型(LLMs)在文本重构方面表现优异,其高计算开销、透明度差和数据隐私问题限制了实际使用。为此,我们探索了参数少于300M的轻量编码器-解码器模型(T5和BERT2BERT),在MIMIC-CXR和CheXpert Plus数据集上结构化放射科报告。我们将其与8个开源大模型(1B–70B参数)对比,采用前缀提示、上下文学习(ICL)和低秩适配(LoRA)微调。最佳轻量模型在人工标注测试集上优于所有提示调优的大模型。部分LoRA微调的大模型在“发现”部分略有提升(BLEU 6.4%,ROUGE-L 4.8%,BERTScore 3.6%,F1-RadGraph 1.1%,GREEN 3.6%,F1-SRR-BERT 4.3%),但推理时间、成本和碳排放超过轻量模型400倍以上。结果表明,轻量、任务专用模型是资源受限医疗环境中可持续、隐私友好的临床文本结构化方案。

原文摘要 · Abstract (English)

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities in reformatting clinical text, their high computational requirements, lack of transparency, and data privacy concerns hinder practical deployment. To address these challenges, we explore lightweight encoder-decoder models (<300M parameters)-specifically T5 and BERT2BERT-for structuring radiology reports from the MIMIC-CXR and CheXpert Plus datasets. We benchmark these models against eight open-source LLMs (1B-70B), adapted using prefix prompting, in-context learning (ICL), and low-rank adaptation (LoRA) finetuning. Our best-performing lightweight model outperforms all LLMs adapted using prompt-based techniques on a human-annotated test set. While some LoRA-finetuned LLMs achieve modest gains over the lightweight model on the Findings section (BLEU 6.4%, ROUGE-L 4.8%, BERTScore 3.6%, F1-RadGraph 1.1%, GREEN 3.6%, and F1-SRR-BERT 4.3%), these improvements come at the cost of substantially greater computational resources. For example, LLaMA-3-70B incurred more than 400 times the inference time, cost, and carbon emissions compared to the lightweight model. These results underscore the potential of lightweight, task-specific models as sustainable and privacy-preserving solutions for structuring clinical text in resource-constrained healthcare settings.

轻量模型医学文本结构化报告隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。