构建通用医学图像分割模型,减少对特定任务模型的依赖。
Foundation AI Model for Medical Image Segmentation
- 借鉴自然图像模型,适配医学图像进行迁移学习
- 可处理小样本数据,避免重复开发专用模型
- 适合医疗领域研究者与临床医生快速应用
基础模型是指在海量数据上训练、具备跨任务广泛泛化能力且精度高的人工智能模型,提供一劳永逸的解决方案,无需为每个任务单独开发模型。例如,ChatGPT 和 Segment Anything Model(SAM)分别在文本处理和自然图像分割中展现出强大性能。在医学图像分割领域,亟需此类通用模型,以替代当前需要开发数千个专用模型的现状,尤其适用于数据量不足的场景。本文探讨了两条实现路径:一是将自然图像预训练模型(如SAM)迁移到医学图像;二是从零开始仅用医学图像训练新模型。文章分析了现有进展、挑战与未来机遇。
原文摘要 · Abstract (English)
Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or one-for-all solutions, eliminating the need for developing task-specific AI models. Examples of such foundation models include the Chat Generative Pre-trained Transformer (ChatGPT) and the Segment Anything Model (SAM). These models have been trained on millions to billions of samples and have shown wide-ranging and accurate applications in numerous tasks such as text processing (using ChatGPT) and natural image segmentation (using SAM). In medical image segmentation - finding target regions in medical images - there is a growing need for these one-for-many or one-for-all foundation models. Such models could obviate the need to develop thousands of task-specific AI models, which is currently standard practice in the field. They can also be adapted to tasks with datasets too small for effective training. We discuss two paths to achieve foundation models for medical image segmentation and comment on progress, challenges, and opportunities. One path is to adapt or fine-tune existing models, originally developed for natural images, for use with medical images. The second path entails building models from scratch, exclusively training on medical images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。