arXiv:2606.03417cs.CV2026-06被引 4

让AI像医生一样分步诊断胸片,还能解释每一步判断依据。

A unified multi-task framework enables interpretable chest radiograph analysis

论文配图:A unified multi-task framework enables interpretable chest radiograph analysis
图 1 · 摘自论文原文
  • 用统一的Transformer模型分三步模拟医生读片流程:识别疾病、分析病灶特征、生成带依据的报告。
  • 在10个胸片数据集上表现优异,盲评中66%的AI报告比原始报告更清晰。
  • 适合临床医生验证AI结论,也适合研究可信医疗AI系统的人参考。

尽管多模态深度学习推动了医学影像分析发展,但现有黑箱系统常局限于单一任务,忽视临床诊断的多任务特性与信任需求。我们提出IMT-CXR(可解释多任务胸部X光分析变压器),通过三个循证阶段模拟放射科医生的诊断流程:1)疾病识别;2)病灶特征刻画(如大小、位置、严重程度量化);3)基于证据整合的报告生成并保留可追溯决策路径。该框架采用统一的Transformer架构,经医学领域指令微调优化,依次完成四项临床任务:多标签疾病分类、病灶定位、解剖结构分割和放射科报告生成。实验在十个胸片基准测试中验证了其在直接推理与微调设置下的竞争力。对来自四个医学中心的160份历史报告进行盲评,三位放射科医生评定66%的AI生成报告在诊断清晰度上达到或超过原临床报告水平,凸显其转化潜力。通过建立从解剖发现到诊断结论的可追溯路径,本工作弥合了AI技术指标与临床实用性之间的差距,推动可信医疗AI的发展。

原文摘要 · Abstract (English)

While multimodal deep learning has advanced medical imaging analysis, existing black-box systems \textcolor{black}{may remain confined to isolated tasks, often overlooking} the trust-sensitive nature of clinical diagnosis as a multi-task process. We propose IMT-CXR (Interpretable Multi-task Transformer for Chest X-ray Analysis), a framework that emulates radiologists' diagnostic workflow through three evidence-driven stages: 1) Disease recognition; 2) Attribute characterization (e.g., size, location, severity quantification); 3) Evidence-integrated report generation with traceable decision pathways. The framework employs a unified transformer architecture optimized via medical-domain instruction tuning, sequentially executing four clinical tasks: multi-label disease classification, lesion localization, anatomical segmentation, and radiology report generation. Experimental validation demonstrates competitive performance on ten CXR benchmarks under direct inference and fine-tuning settings. In a blinded evaluation of 160 historical reports from four medical centers, three radiologists rated 66\% of AI-generated reports as comparable to or surpassing original clinical reports in diagnostic clarity, highlighting the framework's translational potential. By establishing traceable diagnostic pathways from anatomical findings to conclusions, this work bridges the gap between AI technical metrics and clinical utility, advancing trustworthy AI systems in medical imaging.

可解释性医学影像多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。