区分正常与异常特征,提升医学影像报告生成精度
FODA-PG for Enhanced Medical Imaging Narrative Generation: Adaptive Differentiation of Normal and Abnormal Attributes
- 将病灶属性分为疾病特异和无病态两类,实现细粒度建模
- 在IU-Xray和MIMIC-CXR上优于当前最佳方法,报告更准确
- 适合需要高临床可信度的医学AI应用,如辅助诊断系统
自动医学影像叙述生成旨在通过直接从放射学图像生成准确的临床描述,减轻放射科医生的工作负担。然而,与通用图像字幕任务相比,医学图像中的细微视觉差异和领域特定术语带来了显著挑战。现有方法常忽视正常与异常发现之间的关键区别,导致性能不佳。本文提出FODA-PG,一种新颖的细粒度器官-疾病自适应划分图框架,通过领域自适应学习解决这些局限。FODA-PG基于临床意义和位置,将疾病相关属性划分为“疾病特异性”和“无病态”两类,构建放射学发现的精细图表示。这种自适应划分使模型能捕捉正常与病理状态间的细微差异,缓解数据偏差影响。通过将此细粒度语义知识融入强大的Transformer架构,并提供严格的数学论证其有效性,FODA-PG生成精确且临床连贯的报告,具备更强泛化能力。在IU-Xray和MIMIC-CXR基准上的大量实验表明,该方法优于当前最优方法,凸显了领域自适应在医学报告生成中的重要性。
原文摘要 · Abstract (English)
Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images. However, the subtle visual nuances and domain-specific terminology in medical images pose significant challenges compared to generic image captioning tasks. Existing approaches often neglect the vital distinction between normal and abnormal findings, leading to suboptimal performance. In this work, we propose FODA-PG, a novel Fine-grained Organ-Disease Adaptive Partitioning Graph framework that addresses these limitations through domain-adaptive learning. FODA-PG constructs a granular graphical representation of radiological findings by separating disease-related attributes into distinct "disease-specific" and "disease-free" categories based on their clinical significance and location. This adaptive partitioning enables our model to capture the nuanced differences between normal and pathological states, mitigating the impact of data biases. By integrating this fine-grained semantic knowledge into a powerful transformer-based architecture and providing rigorous mathematical justifications for its effectiveness, FODA-PG generates precise and clinically coherent reports with enhanced generalization capabilities. Extensive experiments on the IU-Xray and MIMIC-CXR benchmarks demonstrate the superiority of our approach over state-of-the-art methods, highlighting the importance of domain adaptation in medical report generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。