vesselFM可零样本通用分割3D血管,解决多模态数据差异难题。
vesselFM: A Foundation Model for Universal 3D Blood Vessel Segmentation
- 融合真实数据、随机化生成与流匹配生成,训练通用3D血管分割模型
- 在4种临床相关成像模态上,零/少样本表现均超越现有最优方法
- 适合需跨模态、低标注成本血管分割的研究者与临床应用
3D血管分割在医学图像分析中至关重要却极具挑战,因成像模态间存在显著的伪影、血管模式、尺度、信噪比及背景组织差异,加上成像协议变化带来的域差距,限制了现有监督学习方法的泛化能力,需为每个数据集单独进行体素级标注。尽管基础模型有望缓解此问题,但通常无法泛化至血管分割任务。本文提出vesselFM,一种专为广泛3D血管分割任务设计的基础模型。不同于以往模型,vesselFM能无缝泛化至未见域。为实现零样本泛化,我们在三个异构数据源上训练:大规模标注数据集、领域随机化生成数据,以及基于流匹配的生成模型采样数据。大量评估表明,vesselFM在四种(前)临床相关成像模态中,于零样本、单样本和少样本场景下均优于现有最优医疗图像分割基础模型,提供了一种通用的3D血管分割解决方案。
原文摘要 · Abstract (English)
Segmenting 3D blood vessels is a critical yet challenging task in medical image analysis. This is due to significant imaging modality-specific variations in artifacts, vascular patterns and scales, signal-to-noise ratios, and background tissues. These variations, along with domain gaps arising from varying imaging protocols, limit the generalization of existing supervised learning-based methods, requiring tedious voxel-level annotations for each dataset separately. While foundation models promise to alleviate this limitation, they typically fail to generalize to the task of blood vessel segmentation, posing a unique, complex problem. In this work, we present vesselFM, a foundation model designed specifically for the broad task of 3D blood vessel segmentation. Unlike previous models, vesselFM can effortlessly generalize to unseen domains. To achieve zero-shot generalization, we train vesselFM on three heterogeneous data sources: a large, curated annotated dataset, data generated by a domain randomization scheme, and data sampled from a flow matching-based generative model. Extensive evaluations show that vesselFM outperforms state-of-the-art medical image segmentation foundation models across four (pre-)clinically relevant imaging modalities in zero-, one-, and few-shot scenarios, therefore providing a universal solution for 3D blood vessel segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。