用AI生成PET图像,提升肺癌分型准确率。
Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PET

- 用3D GAN从CT生成伪PET数据,融合多模态信息
- 在714例数据上AUC提升至0.591,GMean达0.524
- 适合无PET设备或需降低辐射的临床场景
非小细胞肺癌(NSCLC)中腺癌(ADC)与鳞状细胞癌(SCC)的准确分型对个性化治疗至关重要。尽管[18F]FDG PET/CT是肺部肿瘤临床评估的标准工具,但其应用常受限于高成本和辐射暴露。本文研究了“虚拟扫描”作为特征增强策略的可行性,评估合成PET数据是否可为解剖性CT提供补充特征以提升组织学亚型分类性能。我们提出一种框架,利用在FDG-PET/CT Lesions数据集上预训练的3D Pix2Pix生成对抗网络(GAN),从解剖性CT生成伪PET体积,并将其与结构化CT数据整合进MINT多阶段中间融合架构。在包含714名受试者的多中心数据集上实验表明,引入合成代谢特征显著优于仅使用CT的基线模型:受试者工作特征曲线下面积(AUC)从0.489提升至0.591,几何均值(GMean)从0.305提升至0.524。结果表明,合成PET图像能提供具有判别力的代谢线索,使深度学习模型有效利用跨模态互补信息,为物理PET扫描不可用的临床场景提供了潜在的特征增强策略。
原文摘要 · Abstract (English)
Accurate histological differentiation between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) is critical for personalized treatment in non-small cell lung cancer (NSCLC). While [$^{18}$F]FDG PET/CT is a standard tool for the clinical evaluation of lung cancer, its utility is often limited by high costs and radiation exposure. In this paper, we investigate the feasibility of "virtual scanning" as a feature-enhancement strategy by evaluating whether synthetic PET data can provide complementary feature representations to supplement anatomical CT scans in histological subtype classification. We propose a framework that leverages a 3D Pix2Pix Generative Adversarial Network (GAN), pretrained on the FDG-PET/CT Lesions dataset, to synthesize pseudo-PET volumes from anatomical CT scans. These synthetic volumes are integrated with structural CT data within the MINT framework, a multi-stage intermediate fusion architecture. Our experiments, conducted on a multi-center dataset of 714 subjects, demonstrate that the inclusion of synthetic metabolic features significantly improves classification performance over a CT-only baseline. The multimodal approach achieved a statistically significant increase in the Area Under the Curve (AUC) from 0.489 to 0.591 and improved the Geometric Mean (GMean) from 0.305 to 0.524. These results suggest that synthetic PET scans provide discriminatory metabolic cues that enable deep learning models to exploit complementary cross-modal information, offering a potential feature-enhancement strategy for clinical scenarios where physical PET scans are unavailable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。