提出数据依赖频域提示,提升无源医学图像分割域适应效果。
DDFP: Data-dependent Frequency Prompt for Source Free Domain Adaptation of Medical Image Segmentation
- 引入预适应阶段生成高质量伪标签,避免额外参数
- 设计数据依赖频域提示,更好还原目标域图像风格
- 专为无源域适应定制层微调策略,提升模型效率
领域自适应旨在缓解因领域差异导致的模型性能下降。传统无监督领域自适应需源域标注数据与目标域未标注数据联合训练,但医疗数据受限于隐私政策,难以获取标注源数据。因此研究逐渐转向无源领域自适应(SFDA),仅需源域预训练模型与目标域未标注数据。现有方法多依赖领域特定图像风格转换与自监督技术,但生成的风格化图像与伪标签质量仍有提升空间,且全模型微调在有限监督下效率较低。本文提出一种新型SFDA框架:首先通过预适应生成预适应模型,作为目标模型初始化,生成高质量增强伪标签且不增加参数;其次提出数据依赖频域提示,更有效地将目标域图像转为源域风格;最后采用专为SFDA设计的风格相关层微调策略,利用提示后的图像与伪标签进行目标模型训练。在跨模态腹部与心脏分割任务上的大量实验表明,该方法优于现有最先进方法。
原文摘要 · Abstract (English)
Domain adaptation addresses the challenge of model performance degradation caused by domain gaps. In the typical setup for unsupervised domain adaptation, labeled data from a source domain and unlabeled data from a target domain are used to train a target model. However, access to labeled source domain data, particularly in medical datasets, can be restricted due to privacy policies. As a result, research has increasingly shifted to source-free domain adaptation (SFDA), which requires only a pretrained model from the source domain and unlabeled data from the target domain data for adaptation. Existing SFDA methods often rely on domain-specific image style translation and self-supervision techniques to bridge the domain gap and train the target domain model. However, the quality of domain-specific style-translated images and pseudo-labels produced by these methods still leaves room for improvement. Moreover, training the entire model during adaptation can be inefficient under limited supervision. In this paper, we propose a novel SFDA framework to address these challenges. Specifically, to effectively mitigate the impact of domain gap in the initial training phase, we introduce preadaptation to generate a preadapted model, which serves as an initialization of target model and allows for the generation of high-quality enhanced pseudo-labels without introducing extra parameters. Additionally, we propose a data-dependent frequency prompt to more effectively translate target domain images into a source-like style. To further enhance adaptation, we employ a style-related layer fine-tuning strategy, specifically designed for SFDA, to train the target model using the prompted target domain images and pseudo-labels. Extensive experiments on cross-modality abdominal and cardiac SFDA segmentation tasks demonstrate that our proposed method outperforms existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。