用相似影像和报告提升脑卒中MRI报告准确性。
Improving Factuality of 3D Brain MRI Report Generation with Paired Image-domain Retrieval and Text-domain Augmentation
- 从3D影像中检索相似病例,用真实报告引导生成。
- 在多个数据集上显著提高缺血区域定位准确率。
- 适合需要高可信度医学报告生成的研究与临床应用。
急性缺血性脑卒中(AIS)需及时决策,影像解读错误可能导致不可逆残疾。弥散加权成像(DWI)和表观弥散系数(ADC)图是检测急性梗死的核心,但直接从3D MRI生成可靠放射科报告仍具挑战,主要因三维图像与临床文本间跨模态对齐困难。本文提出配对图像域检索与文本域增强(PIRTA),一种无需显式图像-文本对齐的检索增强生成框架。PIRTA利用预训练3D视觉编码器检索临床相似的3D DWI/ADC体数据,并借用其对应的医师撰写报告来指导大语言模型(LLM)生成。在多机构内部数据、外部隐私保护队列及公开的ISLES基准上的实验表明,PIRTA在图像域检索上表现优异,并持续提升缺血区域定位准确率——报告事实性的临床指标。结果证明,基于检索的生成为复杂3D脑MRI生成事实一致报告提供了可扩展且可靠的范式。源代码见https://github.com/jhlee0619/PIRTA。
原文摘要 · Abstract (English)
Acute ischemic stroke (AIS) requires time-critical decision-making, where inaccurate interpretation of neuroimaging findings can lead to irreversible disability. Diffusion-weighted imaging (DWI) and apparent diffusion coefficient (ADC) maps from magnetic resonance imaging (MRI) are central to detecting acute infarction, yet generating factually reliable radiology reports directly from 3D MRI remains challenging due to the difficulty of learning robust cross-modal alignments between volumetric images and clinical text. We propose paired image-domain retrieval and text-domain augmentation (PIRTA), a retrieval-augmented generation framework that improves report factuality by avoiding explicit image-text alignment. PIRTA retrieves clinically similar 3D DWI/ADC volumes using a pretrained 3D vision encoder and leverages their paired clinician-authored reports to ground large language model (LLM)-based report generation. Experiments on multi-institutional in-house data, a held-out external privacy-preserving cohort, and the public ISLES benchmark demonstrate that PIRTA achieves strong image-domain retrieval performance and consistently improves ischemic-territory accuracy, a clinically grounded surrogate for report factuality, compared to direct image-to-text baselines. These results indicate that retrieval-grounded generation provides a scalable and reliable paradigm for producing factually consistent radiology reports from complex 3D brain MRI. Source code is available at https://github.com/jhlee0619/PIRTA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。