generative AI与基础模型重塑医疗影像分析范式
Generative AI and Foundation Models in Medical Image

- 基于扩散模型与大语言模型构建通用医学辅助系统
- 利用大规模数据与算力训练可迁移的医疗基础模型
- 适合医疗AI研发者及政策制定者参考
近年来,生成式AI引发广泛关注,应用范围从文本生成、代码创作扩展至医疗支持任务,如诊断报告生成与摘要。代表性模型包括DALL-E 3(OpenAI)、Stable Diffusion(Stability AI)用于图像生成,ChatGPT(OpenAI)与Gemini(Google)用于文本生成。生成式AI的发展依托深度学习进步及遵循缩放定律的大规模数据、模型与计算资源扩展。基础模型通过大规模数据预训练,具备通用知识,适用于多种下游任务,正推动AI开发新范式。这一变革深刻影响医疗影像处理,重塑医疗AI发展框架。本文综述了图像生成中的扩散模型与文本生成中的大语言模型(LLMs)在医疗中的应用,并探讨基础模型的构建方法及其在医学领域的实践。最后分析如何充分利用国家数据与算力资源,构建高性能医疗支持基础模型。
原文摘要 · Abstract (English)
In recent years, generative AI has attracted significant public attention, and its use has been rapidly expanding across a wide range of domains. From creative tasks such as text summarization, idea generation, and source code generation, to the streamlining of medical support tasks like diagnostic report generation and summarization, AI is now deeply involved in many areas. Today's breadth of AI applications is clearly distinct from what was seen before generative AI gained widespread recognition. Representative generative AI services include DALL-E 3 (OpenAI, California, USA) and Stable Diffusion (Stability AI, London, England, UK) for image generation, ChatGPT (OpenAI, California, USA), and Gemini (Google, California, USA) for text generation. The rise of generative AI has been influenced by advances in deep learning models and the scaling up of data, models, and computational resources based on the scaling laws. Moreover, the emergence of foundation models, which are trained on large-scale datasets and possess general-purpose knowledge applicable to various downstream tasks, is creating a new paradigm in AI development. These shifts brought about by generative AI and foundation models also profoundly impact medical image processing, fundamentally changing the framework for AI development in healthcare. This paper provides an overview of diffusion models used in image generation AI and large language models (LLMs) used in text generation AI, and introduces their applications in medical support. This paper also discusses foundation models, which are gaining attention alongside generative AI, including their construction methods and applications in the medical field. Finally, the paper explores how to develop foundation models and high-performance AI for medical support by fully utilizing national data and computational resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。