提出鲁棒匹配方法,提升跨域医学图像分割在少样本下的泛化能力。
RobustEMD: Domain Robust Matching for Cross-domain Few-shot Medical Image Segmentation
- 基于地球移动距离构建跨域特征匹配机制,增强对不同医疗数据域的适应性。
- 在八组数据集上实现当前最优性能,跨模态、跨机构和跨设备序列均有效。
- 适合需要处理多源医疗影像的临床场景,尤其适用于标注数据稀缺的情况。
少样本医学图像分割(FSMIS)旨在医疗图像分析中利用有限标注数据进行学习。尽管已有进展,但现有模型均在同一数据域内训练与部署,这与临床实际中医学影像常跨越不同数据域(如成像模态、机构、设备序列)的情况不符。如何提升模型在不同特定医学影像域间的泛化能力?本文聚焦于少样本语义分割模型的匹配机制,提出一种基于地球移动距离(EMD)的跨域鲁棒匹配方法。具体地,我们构建支持集与查询集前景特征间的EMD传输过程,并引入纹理结构感知权重生成方法——通过在节点上进行Sobel图像梯度计算来抑制域相关节点。此外,采用点集级别距离度量计算支持集节点到查询集节点的传输代价。为评估模型性能,我们在三种跨域场景(跨模态、跨序列、跨机构)下进行了实验,涵盖八组医学数据集及三个身体部位,结果表明该模型在对比方法中达到最先进水平。
原文摘要 · Abstract (English)
Few-shot medical image segmentation (FSMIS) aims to perform the limited annotated data learning in the medical image analysis scope. Despite the progress has been achieved, current FSMIS models are all trained and deployed on the same data domain, as is not consistent with the clinical reality that medical imaging data is always across different data domains (e.g. imaging modalities, institutions and equipment sequences). How to enhance the FSMIS models to generalize well across the different specific medical imaging domains? In this paper, we focus on the matching mechanism of the few-shot semantic segmentation models and introduce an Earth Mover's Distance (EMD) calculation based domain robust matching mechanism for the cross-domain scenario. Specifically, we formulate the EMD transportation process between the foreground support-query features, the texture structure aware weights generation method, which proposes to perform the sobel based image gradient calculation over the nodes, is introduced in the EMD matching flow to restrain the domain relevant nodes. Besides, the point set level distance measurement metric is introduced to calculated the cost for the transportation from support set nodes to query set nodes. To evaluate the performance of our model, we conduct experiments on three scenarios (i.e., cross-modal, cross-sequence and cross-institution), which includes eight medical datasets and involves three body regions, and the results demonstrate that our model achieves the SoTA performance against the compared models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。