CRF-GAN生成高质量3D肺部CT图像,更省内存、更快训练。
Comparative clinical evaluation of "memory-efficient" synthetic 3d generative adversarial networks (gan) head-to-head to state of art: results on computed tomography of the chest
- 引入条件随机场提升3D医学图像生成的空间一致性。
- 相比HA-GAN,FID和MMD更低,12位放射科医生更偏好其生成图像。
- 内存降低9.34%,训练速度提升14.6%,适合资源受限场景。
生成对抗网络(GAN)被广泛用于生成合成医学图像,以缓解人工智能系统训练中标注数据不足的问题。本研究提出CRF-GAN,一种新型内存高效的3D GAN架构,通过两阶段生成流程整合条件随机场,提升3D医学图像的结构一致性与空间连贯性,同时保持高分辨率质量。在计算断层扫描胸部数据集上,将CRF-GAN与先进级联(HA)-GAN模型进行对比,采用定量指标(FID、MMD)和定性评估(由12名住院医师完成的双选项强制选择测试)综合评价。结果表明,CRF-GAN在两项指标上均优于HA-GAN,且2AFC测试中生成图像显著更受青睐;同时,其内存使用降低9.34%,训练速度最快提升14.6%。该模型不仅降低了计算成本,还为实现更高分辨率3D成像提供了资源支持,推动其临床应用。本研究结合定量与定性评估,提供更全面的性能反馈。
原文摘要 · Abstract (English)
Generative Adversarial Networks (GANs) are increasingly used to generate synthetic medical images, addressing the critical shortage of annotated data for training Artificial Intelligence systems. This study introduces CRF-GAN, a novel memory-efficient GAN architecture that enhances structural consistency in 3D medical image synthesis. Integrating Conditional Random Fields within a two-step generation process allows CRF-GAN improving spatial coherence while maintaining high-resolution image quality. The model's performance is evaluated against the state-of-the-art hierarchical (HA)-GAN model. Materials and Methods: We evaluate the performance of CRF-GAN against the HA-GAN model. The comparison between the two models was made through a quantitative evaluation, using FID and MMD metrics, and a qualitative evaluation, through a two-alternative forced choice (2AFC) test completed by a pool of 12 resident radiologists, to assess the realism of the generated images. Results: CRF-GAN outperformed HA-GAN with lower FID and MMD scores, indicating better image fidelity. The 2AFC test showed a significant preference for images generated by CRF-Gan over those generated by HA-GAN. Additionally, CRF-GAN demonstrated 9.34% lower memory usage and achieved up to 14.6% faster training speeds, offering substantial computational savings. Discussion: CRF-GAN model successfully generates high-resolution 3D medical images with non-inferior quality to conventional models, while being more memory-efficient and faster. The key objective was not only to lower the computational cost but also to reallocate the freed-up resources towards the creation of higher-resolution 3D imaging, which is still a critical factor limiting their direct clinical applicability. Moreover, unlike many previous studies, we combined qualitative and quantitative assessments to obtain a more holistic feedback on the model's performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。