用扩散模型与GAN融合提升伪造胸片质量,助力肺癌早期诊断
DiffusionXRay: A Diffusion and GAN-Based Approach for Enhancing Digitally Reconstructed Chest Radiographs
- 结合扩散模型与GAN,分两阶段修复低质合成胸片
- 在真实高质图像上训练后,显著提升清晰度与对比度
- 适合医学影像生成与数据增强研究者使用
基于深度学习的肺癌自动化诊断已成为关键进展,可帮助医护人员早期发现并治疗。然而,这些模型需要大量具有多样性的标注数据,尤其是对难以察觉的微小肺结节,即便经验丰富的放射科医生也常漏诊。高质量标注数据稀缺限制了模型性能和跨人群泛化能力。利用CT扫描生成带人工肺结节的合成正位胸片(DRR)是一种潜在解决方案,但存在图像质量严重下降的问题,如解剖结构模糊、肺野细节丢失。为此,本文提出DiffusionXRay,一种融合去噪扩散概率模型(DDPMs)与生成对抗网络(GANs)的新型图像恢复流程。该方法采用两阶段训练:首先分别使用DDPM-LQ和基于MUNIT的GAN方法生成低质量胸片,解决训练数据稀缺问题;随后在成对的低/高质量图像上训练基于DDPM的模型,以学习胸片恢复的细微特征。实验表明,该方法显著提升了图像清晰度、对比度及整体诊断价值,同时保留了临床重要的细微异常,经量化指标与放射科专家评估验证。
原文摘要 · Abstract (English)
Deep learning-based automated diagnosis of lung cancer has emerged as a crucial advancement that enables healthcare professionals to detect and initiate treatment earlier. However, these models require extensive training datasets with diverse case-specific properties. High-quality annotated data is particularly challenging to obtain, especially for cases with subtle pulmonary nodules that are difficult to detect even for experienced radiologists. This scarcity of well-labeled datasets can limit model performance and generalization across different patient populations. Digitally reconstructed radiographs (DRR) using CT-Scan to generate synthetic frontal chest X-rays with artificially inserted lung nodules offers one potential solution. However, this approach suffers from significant image quality degradation, particularly in the form of blurred anatomical features and loss of fine lung field structures. To overcome this, we introduce DiffusionXRay, a novel image restoration pipeline for Chest X-ray images that synergistically leverages denoising diffusion probabilistic models (DDPMs) and generative adversarial networks (GANs). DiffusionXRay incorporates a unique two-stage training process: First, we investigate two independent approaches, DDPM-LQ and GAN-based MUNIT-LQ, to generate low-quality CXRs, addressing the challenge of training data scarcity, posing this as a style transfer problem. Subsequently, we train a DDPM-based model on paired low-quality and high-quality images, enabling it to learn the nuances of X-ray image restoration. Our method demonstrates promising results in enhancing image clarity, contrast, and overall diagnostic value of chest X-rays while preserving subtle yet clinically significant artifacts, validated by both quantitative metrics and expert radiological assessment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。