用医学实体识别和检索增强生成,提升放射科报告的通俗化摘要质量。
Improving Health Literacy through Lay Summarization of Radiological Reports: An Evaluation of BioNER and Retrieval-Augmented Generation
- 通过医学实体识别提取关键发现,结合检索增强生成上下文
- 微调后的BioBART+NER组合在可读性和准确性上表现最佳
- 单纯使用检索增强会引入幻觉,需配合实体识别才有效
放射科报告主要面向临床医生,专业术语常使患者难以理解。许多患者转向公开的大语言模型(LLMs)寻求解释,但存在事实错误和幻觉等风险。自动化通俗摘要生成成为有前景的替代方案,然而针对放射科场景的检索增强与临床信息融合方法的有效性仍待研究。本研究评估了检索增强生成(RAG)与命名实体识别(NER)对自动生成通俗摘要的质量、事实一致性和可读性的提升效果。构建了结合NER提取临床相关发现与RAG进行上下文定位的框架,在Qwen与BioBART两种模型的少样本与微调变体上进行测试。结果表明,NER能持续提升可读性和整体质量;而仅使用RAG无益处,甚至因无关检索项引入幻觉。在少样本设置中,RAG与NER结合会降低性能;但在微调后,该组合提升了可读性。微调后的BioBART+NER取得最优综合表现,凸显实体感知提取是生成患者友好摘要的核心驱动力。
原文摘要 · Abstract (English)
Radiology reports are written primarily for clinicians, and their specialized terminology often makes them difficult for patients to interpret. As a result, many patients turn to publicly available Large Language Models (LLMs) to help explain their reports, despite well-documented risks of factual inaccuracies and hallucinations. Automated lay-summary generation has emerged as a promising alternative, yet the effectiveness of retrieval-enhanced and clinically informed approaches for radiology-specific communication remains underexplored. This study investigates the extent to which Retrieval-Augmented Generation (RAG) and Named Entity Recognition (NER) improve the quality, factual consistency, and readability of automatically generated lay summaries compared with standard LLM-based generation. We develop a framework combining NER-based extraction of clinically relevant findings with a RAG mechanism for contextual grounding, evaluated across few-shot and fine-tuned variants of two models (Qwen, BioBART). Results show that NER consistently improves readability and overall quality, while RAG alone offers no benefit and can introduce hallucinations from irrelevant retrieved terms. Combining RAG with NER degrades performance in few-shot settings but improves readability when fine-tuned. Fine-tuned BioBART with NER achieves the best overall performance, highlighting entity-aware extraction as the primary driver of improved patient-friendly summaries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。