针对医学影像跨域少样本分割难题,提出频域感知匹配网络。
FAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentation
- 引入频域感知匹配模块,缓解不同成像技术带来的域偏移。
- 在三个跨域数据集上超越现有模型,实现当前最佳性能。
- 适合医疗图像分割中标签稀缺且跨设备场景的研究者。
现有少样本医学图像分割模型未能解决医学影像中因不同成像技术导致的域偏移问题,限制了其在实际任务中的应用。为此,本文聚焦于跨域少样本医学图像分割(CD-FSMIS)任务,旨在构建一个能适应更广泛医学图像分割场景、仅需少量目标域标注数据的通用模型。受不同域间频率域相似性启发,提出频域感知匹配网络(FAMNet),包含两个核心组件:频域感知匹配(FAM)模块和多谱融合(MSF)模块。FAM模块在元学习阶段解决两类问题:1)由于器官与病灶外观差异导致的支持-查询偏差引起的域内方差;2)由不同医学成像技术引发的域间方差。此外,设计了MSF模块以融合FAM模块解耦的多频域特征,进一步降低域间方差对分割性能的影响。结合两者,FAMNet在三个跨域数据集上超越现有少样本医学图像分割及跨域少样本语义分割模型,达到CD-FSMIS任务的最新水平。
原文摘要 · Abstract (English)
Existing few-shot medical image segmentation (FSMIS) models fail to address a practical issue in medical imaging: the domain shift caused by different imaging techniques, which limits the applicability to current FSMIS tasks. To overcome this limitation, we focus on the cross-domain few-shot medical image segmentation (CD-FSMIS) task, aiming to develop a generalized model capable of adapting to a broader range of medical image segmentation scenarios with limited labeled data from the novel target domain. Inspired by the characteristics of frequency domain similarity across different domains, we propose a Frequency-aware Matching Network (FAMNet), which includes two key components: a Frequency-aware Matching (FAM) module and a Multi-Spectral Fusion (MSF) module. The FAM module tackles two problems during the meta-learning phase: 1) intra-domain variance caused by the inherent support-query bias, due to the different appearances of organs and lesions, and 2) inter-domain variance caused by different medical imaging techniques. Additionally, we design an MSF module to integrate the different frequency features decoupled by the FAM module, and further mitigate the impact of inter-domain variance on the model's segmentation performance. Combining these two modules, our FAMNet surpasses existing FSMIS models and Cross-domain Few-shot Semantic Segmentation models on three cross-domain datasets, achieving state-of-the-art performance in the CD-FSMIS task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。