arXiv:2410.13472cs.CV2024-10

提出昼夜自适应框架,用测试数据实现无源医疗图像分割模型更新。

Day-Night Adaptation: An Innovative Source-free Adaptation Framework for Medical Image Segmentation

  • 利用昼夜周期分阶段处理测试数据,白天调优提示词,夜间复用数据微调模型。
  • 在两个医学图像分割基准上超越现有无源与测试时自适应方法。
  • 适合临床场景中数据隐私要求高、夜间无新数据的医疗中心使用。

不同医疗机构采集的医学图像存在分布偏移,阻碍了在某中心训练的语义分割模型向其他中心部署。尽管无监督域适应能缓解此问题,但需共享数据,存在隐私风险。为此,无源域适应(SFDA)和测试时自适应(TTA)应运而生,仅依赖目标域数据。但SFDA需预先收集目标数据集,而TTA仅单次处理测试数据,未能充分挖掘其价值。考虑到多数医疗机构日间运行、夜间停摆的实际场景,本文提出昼夜自适应(DyNA)框架,通过昼夜循环实现无源适配。白天,对每个测试样本训练低频提示词以微调冻结模型,并构建提示词记忆库与预热机制提升训练效果;夜间,重用日间采集的测试数据,引入全局学生模型连接师生模型,促进知识迁移并保证训练稳定。大量实验表明,该方法在两个基准医学图像分割任务上优于现有TTA与SFDA方法。代码将在论文发表后公开。

原文摘要 · Abstract (English)

Distribution shifts widely exist in medical images acquired from different medical centres, hindering the deployment of semantic segmentation models trained on one centre (source domain) to another (target domain). While unsupervised domain adaptation has shown significant promise in mitigating these shifts, it poses privacy risks due to sharing data between centres. To facilitate adaptation while preserving data privacy, source-free domain adaptation (SFDA) and test-time adaptation (TTA) have emerged as effective paradigms, relying solely on target domain data. However, SFDA requires a pre-collected target domain dataset before deployment. TTA insufficiently exploit the potential value of test data, as it processes the test data only once. Considering that most medical centres operate during the day and remain inactive at night in clinical practice, we propose a novel adaptation framework called Day-Night Adaptation (DyNA) with above insights, which performs adaptation through day-night cycles without requiring access to source data. During the day, a low-frequency prompt is trained to adapt the frozen model to each test sample. We construct a memory bank for prompt initialization and develop a warm-up mechanism to enhance prompt training. During the night, we reuse test data collected from the day and introduce a global student model to bridge the knowledge between teacher and student models, facilitating model fine-tuning while ensuring training stability. Extensive experiments demonstrate that our DyNA outperforms existing TTA and SFDA methods on two benchmark medical image segmentation tasks. Code will be available after the paper is published.

医学图像自适应隐私保护测试时

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。