arXiv:2506.10825eess.IVcs.AI2025-06综述被引 10

综述通用医学图像分割模型,对比其与专用模型的性能优劣。

Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approaches

  • 梳理通用模型在医学影像分割中的多种实现方式
  • 实证显示通用模型在多数任务上接近专用模型表现
  • 适合关注AI临床落地与模型泛化能力的研究者

受大型语言模型成功范式启发,通用模型在计算机视觉领域崭露头角。以分割任意图像模型(SAM)为里程碑,催生了众多用于医学图像分割的架构。本文全面深入调研医学图像分割中的通用模型,首先介绍其发展基础概念,随后按零样本、少样本、微调、适配器、SAM 2、仅图像训练模型及图文联合训练模型等类别进行分类。系统分析其在原始研究和文献最优表现中的性能,并与最先进的专用模型进行严格比较。强调需应对监管合规、隐私安全、预算限制及可信AI挑战。最后展望未来方向,包括合成数据、早期融合、自然语言处理中通用模型的经验、代理型AI与物理AI,以及临床转化路径。

原文摘要 · Abstract (English)

Following the successful paradigm shift of large language models, leveraging pre-training on a massive corpus of data and fine-tuning on different downstream tasks, generalist models have made their foray into computer vision. The introduction of Segment Anything Model (SAM) set a milestone on segmentation of natural images, inspiring the design of a multitude of architectures for medical image segmentation. In this survey we offer a comprehensive and in-depth investigation on generalist models for medical image segmentation. We start with an introduction on the fundamentals concepts underpinning their development. Then, we provide a taxonomy on the different declinations of SAM in terms of zero-shot, few-shot, fine-tuning, adapters, on the recent SAM 2, on other innovative models trained on images alone, and others trained on both text and images. We thoroughly analyze their performances at the level of both primary research and best-in-literature, followed by a rigorous comparison with the state-of-the-art task-specific models. We emphasize the need to address challenges in terms of compliance with regulatory frameworks, privacy and security laws, budget, and trustworthy artificial intelligence (AI). Finally, we share our perspective on future directions concerning synthetic data, early fusion, lessons learnt from generalist models in natural language processing, agentic AI and physical AI, and clinical translation.

医学图像通用模型分割综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。