让模型学会判断胸部X光片的时间变化,提升对病情进展的敏感度。
Temporal Inversion for Learning Interval Change in Chest X-Rays
- 用倒序图像对作为监督信号,增强模型对时间方向的感知能力。
- 在多个数据集上显著提升病情进展分类和时序嵌入对齐效果。
- 适用于多种现有模型,适合临床医生和医疗AI研究者使用。
视觉-语言预训练的进展催生了强大的医学基础模型,但多数仅孤立分析影像,忽略了临床核心任务——对比前后影像以评估间隔变化。对于胸部X光片(CXRs),捕捉间隔变化至关重要,因放射科医生需判断病灶的静态表现及其随时间演变情况。我们提出TILA(时序反转感知学习与对齐)框架,通过图像对倒序(时间反转)作为监督信号,提升现有时序视觉-语言模型对方向性变化的敏感度。TILA在预训练、微调和推理阶段均融入反转感知目标,补充传统外观建模,实现显式的时间顺序学习。我们还设计统一评估协议,用于检测时序敏感性和反转一致性,并构建了可通用的MS-CXR-Tretrieval检索数据集。在公开数据集和真实医院队列上的实验表明,TILA在多种现有架构上均能持续提升进展分类性能与时序嵌入对齐效果。
原文摘要 · Abstract (English)
Recent advances in vision--language pretraining have enabled strong medical foundation models, yet most analyze radiographs in isolation, overlooking the key clinical task of comparing prior and current images to assess interval change. For chest radiographs (CXRs), capturing interval change is essential, as radiologists must evaluate not only the static appearance of findings but also how they evolve over time. We introduce TILA (Temporal Inversion-aware Learning and Alignment), a simple yet effective framework that uses temporal inversion, reversing image pairs, as a supervisory signal to enhance the sensitivity of existing temporal vision-language models to directional change. TILA integrates inversion-aware objectives across pretraining, fine-tuning, and inference, complementing conventional appearance modeling with explicit learning of temporal order. We also propose a unified evaluation protocol to assess order sensitivity and consistency under temporal inversion, and introduce MS-CXR-Tretrieval, a retrieval evaluation set constructed through a general protocol that can be applied to any temporal CXR dataset. Experiments on public datasets and real-world hospital cohorts demonstrate that TILA consistently improves progression classification and temporal embedding alignment when applied to multiple existing architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。