让AI看胸片对变化,精准定位多个病灶的进展或消退。
GRCD: Grounded Region Change Detection for Multi-Finding Chest X-Ray Pairs

- 用区域引导的时序编码,结合空间与时间信息生成报告。
- 在多病灶检测上优于现有方法,变化识别准确率显著提升。
- 适合临床辅助诊断,尤其关注病灶动态变化的医生使用。
放射科医生常对比当前与既往胸片以追踪疾病进展,生成包含多个发现的随访报告,每个发现均对应解剖区域并标注时间变化状态。现有自动化方法要么仅基于单张图像生成报告,忽略时序上下文;要么虽引入时序信息但未实现空间定位。少数结合时序推理与空间定位的方法仅限于单一病灶描述,无法处理多病灶、混合变化方向的情况。本文提出GRCD框架,用于多病灶胸片对的定位报告生成。首先通过识别并修正源标注中的两类系统性标注错误,构建一个经过严格清洗的时序胸片对数据集。随后引入区域引导的变化标记模块,编码各解剖结构的区域级时序变化,并通过双路径策略(预置空间标记+门控交叉注意力)注入语言模型。在多病灶测试集上,GRCD在文本生成与临床准确性指标上均超越现有基线,变化检测性能显著提升。消融实验表明,双路径设计优于单一集成方式,且区域级变化编码对多病灶生成至关重要。代码已开源:https://github.com/UTSA-VIRLab/GRCD。
原文摘要 · Abstract (English)
Radiologists routinely compare current and prior chest X-rays to track disease progression, producing follow-up reports that describe multiple findings, each localised to an anatomical region and annotated with a temporal change status. Existing automated methods either generate reports from a single image without modelling temporal context, or incorporate temporal information but do not ground their outputs spatially. The few approaches that combine temporal reasoning with spatial grounding are restricted to single-finding descriptions, leaving multi-finding reports with mixed change directions unaddressed. We present GRCD, a framework for grounded report generation from chest X-ray pairs in the multi-finding setting. We first construct a rigorously cleaned dataset of temporal chest X-ray pairs by identifying and correcting two systematic labelling errors in the source annotations. We then introduce a Region-Guided Change Token module that encodes per-region temporal change across anatomical structures and injects this signal into a language model through a dual-pathway strategy combining prepended spatial tokens with gated cross-attention. On a multi-finding test set, GRCD outperforms existing baselines on text generation and clinical accuracy metrics, with gains in change detection. Ablation studies confirm that the dual-pathway design outperforms either integration strategy in isolation on text and clinical metrics, and that region-level change encoding is necessary for multi-finding generation. Code is available at https://github.com/UTSA-VIRLab/GRCD
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。