arXiv:2501.10733cs.CV2025-01被引 2

融合CNN与Transformer,提升肝癌预测准确率

A CNN-Transformer for Classification of Longitudinal 3D MRI Images -- A Case Study on Hepatocellular Carcinoma Prediction

  • 用3D ConvNeXt+Transformer捕捉影像空间与时间特征
  • 在肝硬化患者数据上预测肝癌准确率显著优于基线模型
  • 适合处理不规则随访、记录长短不一的慢性病监测

纵向MRI分析对预测疾病进展至关重要,尤其在肝细胞癌(HCC)这类慢性病中,早期发现可显著影响治疗策略与预后。然而,受限于数据量少、组织变化细微及筛查时间不规律等问题,现有方法多依赖横断面影像。为此,我们提出HCCNet,一种结合3D ConvNeXt CNN与Transformer编码器的新架构,同时捕获3D MRI的复杂空间特征与多时间点间的动态演变关系。HCCNet采用两阶段自监督预训练:先用适配3D MRI的自监督框架训练CNN主干,再通过序列顺序预测任务预训练Transformer,增强其对疾病进程的理解。我们在定期接受MRI筛查的肝硬化患者队列上验证了该方法,结果表明HCCNet在预测准确性与可靠性上显著优于基线模型,为个性化HCC监测提供了可靠工具。该方法具有通用性,可推广至多种纵向MRI筛查场景,能有效应对患者记录长度差异与不规则随访间隔,是慢性病及时精准预判的重要框架。

原文摘要 · Abstract (English)

Longitudinal MRI analysis is crucial for predicting disease outcomes, particularly in chronic conditions like hepatocellular carcinoma (HCC), where early detection can significantly influence treatment strategies and patient prognosis. Yet, due to challenges like limited data availability, subtle parenchymal changes, and the irregular timing of medical screenings, current approaches have so far focused on cross-sectional imaging data. To address this, we propose HCCNet, a novel model architecture that integrates a 3D adaptation of the ConvNeXt CNN architecture with a Transformer encoder, capturing both the intricate spatial features of 3D MRIs and the complex temporal dependencies across different time points. HCCNet utilizes a two-stage pre-training process tailored for longitudinal MRI data. The CNN backbone is pre-trained using a self-supervised learning framework adapted for 3D MRIs, while the Transformer encoder is pre-trained with a sequence-order-prediction task to enhance its understanding of disease progression over time. We demonstrate the effectiveness of HCCNet by applying it to a cohort of liver cirrhosis patients undergoing regular MRI screenings for HCC surveillance. Our results show that HCCNet significantly improves predictive accuracy and reliability over baseline models, providing a robust tool for personalized HCC surveillance. The methodological approach presented in this paper is versatile and can be adapted to various longitudinal MRI screening applications. Its ability to handle varying patient record lengths and irregular screening intervals establishes it as an invaluable framework for monitoring chronic diseases, where timely and accurate disease prognosis is critical for effective treatment planning.

肝癌预测纵向影像3D CNNTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。