arXiv:2602.16006cs.CV2026-02中稿 · Medical Imaging wi…被引 1

用可解释特征生成脑瘤报告,减少幻觉并预测临床结果

BTReport: A Framework for Brain Tumor Radiology Report Generation with Clinically Relevant Features

  • 先提取影像特征再用大模型组织语言,过程可解释
  • 生成报告与临床报告匹配度高于现有方法
  • 特征能预测生存期和IDH突变状态,适合临床研究

近期放射科报告生成(RRG)进展依赖于大规模图像-文本配对数据集;然而,由于缺乏开放的图像-报告配对数据集,神经肿瘤学领域的进展受限。本文提出BTReport,一个开源的脑瘤放射科报告生成框架,通过确定性提取的影像特征生成自然语言报告。不同于依赖大型通用或微调视觉-语言模型进行图像解读与报告生成的方法,BTReport将图像分析步骤改为确定性特征提取,仅使用大语言模型进行语法结构与叙事格式构建。通过将报告生成拆分为确定性特征提取与报告生成两步,生成报告完全可解释且更少产生幻觉。我们证明用于报告生成的特征可预测关键临床结局,包括生存率和IDH突变状态,且BTReport生成的报告比现有基线更接近参考临床报告。最后,我们引入了BTReport-BraTS,一个配套数据集,通过合成生成的报告扩展BraTS影像数据。项目代码见https://github.com/KurtLabUW/BTReport。

原文摘要 · Abstract (English)

Recent advances in radiology report generation (RRG) have been driven by large paired image-text datasets; however, progress in neuro-oncology has been limited due to a lack of open paired image-report datasets. Here, we introduce BTReport, an open-source framework for brain tumor RRG that constructs natural language radiology reports using deterministically extracted imaging features. Unlike existing approaches that rely on large general-purpose or fine-tuned vision-language models for both image interpretation and report composition, BTReport performs deterministic feature extraction for image analysis and uses large language models only for syntactic structuring and narrative formatting. By separating RRG into a deterministic feature extraction step and a report generation step, the generated reports are completely interpretable and less prone to hallucinations. We show that the features used for report generation are predictive of key clinical outcomes, including survival and IDH mutation status, and reports generated by BTReport are more closely aligned with reference clinical reports than existing baselines for RRG. Finally, we introduce BTReport-BraTS, a companion dataset that augments BraTS imaging with synthetically generated radiology reports produced with BTReport. Code for this project can be found at https://github.com/KurtLabUW/BTReport.

医学报告生成可解释性脑瘤大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。