用生成式AI补全缺失的乳腺癌影像,提升无创诊断准确率。
Augmented Intelligence for Multimodal Virtual Biopsy in Breast Cancer Using Generative Artificial Intelligence
- 通过生成式AI从普通钼靶图合成对比增强影像
- 合成影像使虚拟活检准确率显著高于仅用普通钼靶
- 适合需要提升诊断精度的临床医生和研究者
全视野数字乳腺摄影(FFDM)是乳腺癌筛查的主要影像手段,但在致密型乳腺或纤维囊性病变患者中效果有限。对比增强光谱乳腺摄影(CESM)虽能提高肿瘤检出准确性,但因辐射剂量高、需使用造影剂且可及性差,通常仅用于特定病例。目前许多患者仍只能依赖FFDM,而无法享受CESM的更高诊断性能。尽管活检是确诊金标准,但其为有创操作,会给患者带来不适。本文提出一种多模态、多视角深度学习方法,融合FFDM与CESM在头尾位和内外斜位的图像,对病灶进行良恶性分类。针对CESM数据缺失问题,采用生成式人工智能从FFDM扫描中重建合成的CESM图像。实验表明,引入真实或合成的CESM信息对提升虚拟活检性能至关重要。当真实CESM缺失时,合成图像表现优于单独使用FFDM,尤其在多模态融合配置下效果更优。该方法有望优化临床诊断流程,为医生提供增强智能支持,提升诊断准确性和患者照护水平。此外,我们公开了实验所用数据集,以促进该领域的进一步发展。
原文摘要 · Abstract (English)
Full-Field Digital Mammography (FFDM) is the primary imaging modality for routine breast cancer screening; however, its effectiveness is limited in patients with dense breast tissue or fibrocystic conditions. Contrast-Enhanced Spectral Mammography (CESM), a second-level imaging technique, offers enhanced accuracy in tumor detection. Nonetheless, its application is restricted due to higher radiation exposure, the use of contrast agents, and limited accessibility. As a result, CESM is typically reserved for select cases, leaving many patients to rely solely on FFDM despite the superior diagnostic performance of CESM. While biopsy remains the gold standard for definitive diagnosis, it is an invasive procedure that can cause discomfort for patients. We introduce a multimodal, multi-view deep learning approach for virtual biopsy, integrating FFDM and CESM modalities in craniocaudal and mediolateral oblique views to classify lesions as malignant or benign. To address the challenge of missing CESM data, we leverage generative artificial intelligence to impute CESM images from FFDM scans. Experimental results demonstrate that incorporating the CESM modality is crucial to enhance the performance of virtual biopsy. When real CESM data is missing, synthetic CESM images proved effective, outperforming the use of FFDM alone, particularly in multimodal configurations that combine FFDM and CESM modalities. The proposed approach has the potential to improve diagnostic workflows, providing clinicians with augmented intelligence tools to improve diagnostic accuracy and patient care. Additionally, as a contribution to the research community, we publicly release the dataset used in our experiments, facilitating further advancements in this field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。