arXiv:2608.19666cs.CV2026-08

多示踪剂自监督学习提升癌症病灶分割泛化能力

MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation

论文配图:MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation
图 1 · 摘自论文原文
  • 用多模态掩码重建实现跨示踪剂自监督训练
  • 少标签下分割性能显著优于从零训练
  • 适合医疗影像标注稀缺场景的模型开发

基于深度学习的全身PET-CT病灶分割可辅助癌症分期、治疗规划与疗效评估,但受限于标注数据稀少和域偏移问题。自监督学习(SSL)可缓解此问题,但在泛癌种、多示踪剂PET-CT中仍研究不足。本文提出MUST-PET(MUltimodal Self-supervised learning across Tracers),一种用于泛化性全身PET-CT病灶分割的多模态、多示踪剂自监督框架。该框架在包含多种癌症、多机构采集的FDG与前列腺特异性膜抗原(PSMA)示踪剂扫描数据上训练与验证。MUST-PET采用上下文感知掩码重建策略:部分模态被遮蔽,利用PET与CT间的互补信息进行重建。预训练模型经少量标注样本微调后,在重建质量、病灶分割、标签效率及跨独立外部数据集的泛化能力方面均表现优异,证明了多示踪剂自监督学习在标签高效、泛化性强的全身PET-CT分割中的潜力。

原文摘要 · Abstract (English)

Deep learning-based whole-body PET-CT lesion segmentation can support cancer staging, treatment planning, and response assessment, but generalization is limited by scarce annotations and domain shifts. Self-supervised learning (SSL) can address these challenges but remains underexplored in pan-cancer, multi-tracer PET-CT. In this work, we propose MUST-PET (MUltimodal Self-Supervised learning across Tracers), a multimodal, multi-tracer SSL framework for generalizable whole-body PET-CT lesion segmentation. MUST-PET is trained and validated on a diverse, multi-institutional collection of pan-cancer PET-CT scans acquired with FDG and prostate-specific membrane antigen (PSMA)-targeted radiotracers. MUST-PET uses context-aware masked reconstruction, where one modality is partially masked and reconstructed using complementary information from both PET and CT. The pretrained model is subsequently fine-tuned with labeled samples and evaluated for reconstruction quality, lesion segmentation, label efficiency, and generalizability across independent held-out datasets. MUST-PET reduces reconstruction error, improves lesion segmentation over training from scratch, and performs well with limited labeled data and on unseen external datasets, demonstrating the potential of multi-tracer SSL for label-efficient, generalizable whole-body PET-CT. segmentation.

PET-CT自监督学习病灶分割多示踪剂

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。