arXiv:2506.23584eess.IVcs.AI2025-06被引 3

用两阶段模型自动生成肾癌CT报告,提升临床准确性。

A Clinically-Grounded Two-Stage Framework for Renal CT Report Generation

  • 先检测图像特征,再基于特征生成报告
  • 关键影像特征识别AUC达0.75,报告质量METEOR为0.33
  • 适合医疗AI开发者和放射科医生参考

肾癌是常见恶性肿瘤,也是癌症致死主因之一。计算机断层扫描(CT)在早期发现、分期及治疗规划中至关重要。然而,日益增长的CT检查量加重了放射科医生负担,可能导致报告不完整。自动生成准确报告仍具挑战,需融合视觉解读与临床推理。本文提出一种临床导向的两阶段框架:第一阶段采用多任务学习模型,在每张2D图像中检测结构化临床特征;第二阶段利用视觉语言模型,结合图像与检测到的特征生成自由文本报告。为评估临床真实性,从生成报告中提取临床特征,并与专家标注的真值进行对比。在专家标注数据集上的实验表明,引入检测特征显著提升了报告质量和临床准确性。模型在关键影像特征上的平均AUC为0.75,METEOR得分为0.33,表现出更高的临床一致性与更少模板化错误。结果表明,将结构化特征检测与条件化报告生成结合,可实现更具临床依据的肾癌CT报告自动生成,增强可解释性与临床可信度,强调了领域相关评估指标在医疗AI开发中的价值。

原文摘要 · Abstract (English)

Objective Renal cancer is a common malignancy and a major cause of cancer-related deaths. Computed tomography (CT) is central to early detection, staging, and treatment planning. However, the growing CT workload increases radiologists' burden and risks incomplete documentation. Automatically generating accurate reports remains challenging because it requires integrating visual interpretation with clinical reasoning. Advances in artificial intelligence (AI), especially large language and vision-language models, offer potential to reduce workload and enhance diagnostic quality. Methods We propose a clinically informed, two-stage framework for automatic renal CT report generation. In Stage 1, a multi-task learning model detects structured clinical features from each 2D image. In Stage 2, a vision-language model generates free-text reports conditioned on the image and the detected features. To evaluate clinical fidelity, generated clinical features are extracted from the reports and compared with expert-annotated ground truth. Results Experiments on an expert-labeled dataset show that incorporating detected features improves both report quality and clinical accuracy. The model achieved an average AUC of 0.75 for key imaging features and a METEOR score of 0.33, demonstrating higher clinical consistency and fewer template-driven errors. Conclusion Linking structured feature detection with conditioned report generation provides a clinically grounded approach to integrate structured prediction and narrative drafting for renal CT reporting. This method enhances interpretability and clinical faithfulness, underscoring the value of domain-relevant evaluation metrics for medical AI development.

医学影像自然语言生成肾癌两阶段模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。