生成式AI助力医学影像数据合成与跨模态转换,推动临床应用落地。
Generative Artificial Intelligence in Medical Imaging: Foundations, Progress, and Clinical Translation
- 基于GAN、VAE与扩散模型的生成技术提升影像质量与数据多样性。
- 在数据稀缺场景下实现跨模态影像合成,支持诊断与治疗规划。
- 提出多层级评估框架,助力生成模型临床转化与可靠性验证。
生成式人工智能正快速重塑医学影像领域,实现数据合成、图像增强、模态转换及时空建模等能力。本文系统综述了生成对抗网络(GANs)、变分自编码器(VAEs)、扩散模型以及新兴多模态基础架构的最新进展,评估其在医学影像全流程中的作用,涵盖成像采集、重建、跨模态合成、诊断辅助和治疗规划。重点探讨回顾性与前瞻性临床场景中生成模型对数据稀疏性、标准化和多模态整合等长期挑战的应对策略。为推动严格基准测试与临床转化准备,提出包含像素级保真度、特征级真实性和任务级临床相关性的三层评估框架。同时识别实际部署中的关键障碍,如域偏移下的泛化能力、幻觉风险、数据隐私问题与监管难题。最后探讨生成式AI与大规模基础模型的融合趋势,展望可扩展、可靠且临床集成的下一代影像系统。本文旨在勾勒技术进展与转化路径,引导未来研究并促进人工智能、医学与生物工程领域的跨学科协作。
原文摘要 · Abstract (English)
Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and forward-looking synthesis of recent advances in generative modeling including generative adversarial networks (GANs), variational autoencoders (VAEs), diffusion models, and emerging multimodal foundation architectures and evaluates their expanding roles across the clinical imaging continuum. We systematically examine how generative AI contributes to key stages of the imaging workflow, from acquisition and reconstruction to cross-modality synthesis, diagnostic support, and treatment planning. Emphasis is placed on both retrospective and prospective clinical scenarios, where generative models help address longstanding challenges such as data scarcity, standardization, and integration across modalities. To promote rigorous benchmarking and translational readiness, we propose a three-tiered evaluation framework encompassing pixel-level fidelity, feature-level realism, and task-level clinical relevance. We also identify critical obstacles to real-world deployment, including generalization under domain shift, hallucination risk, data privacy concerns, and regulatory hurdles. Finally, we explore the convergence of generative AI with large-scale foundation models, highlighting how this synergy may enable the next generation of scalable, reliable, and clinically integrated imaging systems. By charting technical progress and translational pathways, this review aims to guide future research and foster interdisciplinary collaboration at the intersection of AI, medicine, and biomedical engineering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。