arXiv:2506.03178eess.IVcs.AI2025-06

用LLaMA和QLoRA让AI生成更准的胸部X光报告

LLaMA-XR: A Novel Framework for Radiology Report Generation using LLaMA and QLoRA Fine Tuning

  • 用DenseNet-121提取图像特征,结合LLaMA 3.1进行报告生成
  • 在IU X-ray数据集上ROUGE-L达0.433,METEOR达0.336
  • 通过QLoRA降低显存占用,适合临床部署

自动化放射科报告生成有望减轻放射科医生负担并提升诊断准确性。然而,从胸片生成精确且具有临床意义的报告仍具挑战,原因在于医学语言复杂且需上下文理解。现有模型常难以兼顾准确性和上下文相关性。本文提出LLaMA-XR框架,融合LLaMA 3.1大语言模型与基于DenseNet-121的图像嵌入,并采用量化低秩适配(QLoRA)微调策略。该框架在保持计算高效的同时提升了报告连贯性与临床准确性。其优化策略增强了参数利用率,降低了内存开销,实现了更快的生成速度与更低的资源消耗。在IU X-ray基准数据集上的大量实验表明,LLaMA-XR优于多项先进方法:ROUGE-L得分为0.433,METEOR得分为0.336,创下该领域新基准。这些结果证明了LLaMA-XR作为高效可靠的AI放射报告系统,在临床应用中具备显著潜力。

原文摘要 · Abstract (English)

Automated radiology report generation holds significant potential to reduce radiologists' workload and enhance diagnostic accuracy. However, generating precise and clinically meaningful reports from chest radiographs remains challenging due to the complexity of medical language and the need for contextual understanding. Existing models often struggle with maintaining both accuracy and contextual relevance. In this paper, we present LLaMA-XR, a novel framework that integrates LLaMA 3.1 with DenseNet-121-based image embeddings and Quantized Low-Rank Adaptation (QLoRA) fine-tuning. LLaMA-XR achieves improved coherence and clinical accuracy while maintaining computational efficiency. This efficiency is driven by an optimization strategy that enhances parameter utilization and reduces memory overhead, enabling faster report generation with lower computational resource demands. Extensive experiments conducted on the IU X-ray benchmark dataset demonstrate that LLaMA-XR outperforms a range of state-of-the-art methods. Our model achieves a ROUGE-L score of 0.433 and a METEOR score of 0.336, establishing new performance benchmarks in the domain. These results underscore LLaMA-XR's potential as an effective and efficient AI system for automated radiology reporting, offering enhanced clinical utility and reliability.

医学影像报告生成LLMQLoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。