用多模态深度学习预测头颈癌远处转移风险,准确率超75%
Prediction of Distant Metastasis in Head and Neck Cancer Patients Using Tumor and Peritumoral Multi-Modal Deep Learning
- 融合CT影像、放射组学与临床数据,用3D Swin Transformer提取特征
- 多模态模型AUC达0.803,较单一模态提升显著
- 适用于个性化治疗决策,尤其对不同肿瘤亚型均有良好泛化性
尽管手术、放疗、化疗及靶向治疗联合应用显著改善了头颈癌患者预后,远处转移仍是治疗失败的主要原因。本研究提出一种基于深度学习的多模态框架,整合CT影像、放射组学与临床数据,预测HNSCC患者转移风险。共回顾分析1497例患者,从术前CT生成肿瘤与器官掩码,使用3D Swin Transformer提取深层影像特征,1562个放射组学特征经相关性过滤与随机森林选择缩减至36个。临床数据(年龄、性别、吸烟与饮酒状态)编码后与影像特征融合,输入全连接网络进行预测。采用五折交叉验证评估性能,指标包括AUC、准确率、敏感度与特异度。多模态模型优于所有单模态基线:仅深度学习模块AUC为0.715,而多模态融合显著提升性能(AUC=0.803,ACC=0.752,SEN=0.730,SPE=0.758)。分层分析证实模型在不同肿瘤亚型间具有良好泛化能力。消融实验表明各模态贡献互补,3D Swin Transformer相比传统架构提供更鲁棒表征。该多模态深度学习模型可实现头颈癌远处转移的精准、无创预测,具备个体化治疗规划的强潜力。
原文摘要 · Abstract (English)
Although the combined treatment of surgery, radiotherapy, chemotherapy, and emerging target therapy has significantly improved the outcomes of patients with head and neck cancer, distant metastasis remains the leading cause of treatment failure. In this study, we propose a deep learning-based multimodal framework integrating CT imaging, radiomics, and clinical data to predict metastasis risk in HNSCC. A total of 1497 patients were retrospectively analyzed. Tumor and organ masks were generated from pretreatment CT scans, from which a 3D Swin Transformer extracted deep imaging features, while 1562 radiomics features were reduced to 36 via correlation filtering and random forest selection. Clinical data (age, sex, smoking, and alcohol status) were encoded and fused with imaging features, and the multimodal representation was fed into a fully connected network for prediction. Five-fold cross-validation was used to assess performance via AUC, accuracy, sensitivity, and specificity. The multimodal model outperformed all single-modality baselines. The deep learning module alone achieved an AUC of 0.715, whereas multimodal fusion significantly improved performance (AUC = 0.803, ACC = 0.752, SEN = 0.730, SPE = 0.758). Stratified analyses confirmed good generalizability across tumor subtypes. Ablation experiments demonstrated complementary contributions from each modality, and the 3D Swin Transformer provided more robust representations than conventional architectures. This multimodal deep learning model enables accurate, non-invasive metastasis prediction in HNSCC and shows strong potential for individualized treatment planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。