arXiv:2502.03999eess.IVcs.CV2025-02被引 18

用自监督模型区分胶质母细胞瘤放疗后假性进展与真性进展。

A Self-supervised Multimodal Deep Learning Approach to Differentiate Post-radiotherapy Progression from Pseudoprogression in Glioblastoma

  • 基于自监督ViT提取多序列MRI特征,融合临床与放疗数据
  • 在两个独立数据集上实现75.3%的AUC,优于现有方法
  • 仅需常规影像和放疗信息,临床应用性强

胶质母细胞瘤放疗后假性进展(PsP)与真性进展(TP)的准确区分对治疗方案制定至关重要,但二者影像特征重叠导致判断困难。本研究提出一种多模态深度学习方法,利用常规解剖MRI、临床参数及放疗计划信息进行联合建模。采用自监督视觉变压器(ViT)对来自BraTS2021、UPenn-GBM和UCSF-PDGM的无标签胶质瘤MRI数据进行预训练,从FLAIR和T1增强序列中提取紧凑且具临床意义的表示。通过引导式跨模态注意力机制将编码后的影像特征与临床数据及放疗计划信息融合,提升分类性能。模型在两个中心数据集上验证:Burdenko GBM进展数据集(n=59)用于训练与验证,UKER GlioCMV数据集(n=20)用于测试。最终达到75.3% AUC,优于当前主流数据驱动方法。该方法仅依赖常规MRI、临床数据与放疗计划,具备良好临床可行性,有望改善决策并优化治疗方案。

原文摘要 · Abstract (English)

Accurate differentiation of pseudoprogression (PsP) from True Progression (TP) following radiotherapy (RT) in glioblastoma (GBM) patients is crucial for optimal treatment planning. However, this task remains challenging due to the overlapping imaging characteristics of PsP and TP. This study therefore proposes a multimodal deep-learning approach utilizing complementary information from routine anatomical MR images, clinical parameters, and RT treatment planning information for improved predictive accuracy. The approach utilizes a self-supervised Vision Transformer (ViT) to encode multi-sequence MR brain volumes to effectively capture both global and local context from the high dimensional input. The encoder is trained in a self-supervised upstream task on unlabeled glioma MRI datasets from the open BraTS2021, UPenn-GBM, and UCSF-PDGM datasets to generate compact, clinically relevant representations from FLAIR and T1 post-contrast sequences. These encoded MR inputs are then integrated with clinical data and RT treatment planning information through guided cross-modal attention, improving progression classification accuracy. This work was developed using two datasets from different centers: the Burdenko Glioblastoma Progression Dataset (n = 59) for training and validation, and the GlioCMV progression dataset from the University Hospital Erlangen (UKER) (n = 20) for testing. The proposed method achieved an AUC of 75.3%, outperforming the current state-of-the-art data-driven approaches. Importantly, the proposed approach relies on readily available anatomical MRI sequences, clinical data, and RT treatment planning information, enhancing its clinical feasibility. The proposed approach addresses the challenge of limited data availability for PsP and TP differentiation and could allow for improved clinical decision-making and optimized treatment plans for GBM patients.

胶质瘤多模态学习自监督影像诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。