在隐私保护下,用多窗肺部CT持续学习,提升模型泛化能力。
Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustness
- 通过隐空间回放机制,在不使用原始数据前提下持续学习。
- 在两种不同窗宽设置的肺部CT上,准确率优于现有方法。
- 适合医疗领域动态环境下的模型迭代与隐私合规场景。
我们提出一种新颖的持续自监督学习(CSSL)框架,可从多窗肺部计算机断层扫描(CT)图像中同时学习多样化特征并保障数据隐私。在医学影像诊断中,构建鲁棒且高度泛化的模型面临挑战,主要源于大规模精准标注数据集稀缺以及动态医疗环境中固有的域偏移问题。特别是在肺部CT中,域偏移常由为不同临床目的优化的窗宽设置差异引起。以往的CSSL框架通常依赖重用历史数据缓解域偏移,但这一做法因隐私限制而难以实施。我们的方法通过在无标签图像上进行持续预训练,有效捕捉不同训练阶段间先前知识与新信息的关系。具体而言,将基于隐空间回放的机制引入CSSL,缓解了持续预训练中因域偏移导致的灾难性遗忘,同时确保数据隐私。此外,我们引入一种融合Wasserstein距离知识蒸馏(WKD)与批次知识集成(BKE)的特征蒸馏技术,增强模型学习域偏移鲁棒表征的能力。最后,我们在两种不同窗宽设置获取的肺部CT图像上验证了该方法,结果表明其性能显著优于其他方法。
原文摘要 · Abstract (English)
We propose a novel continual self-supervised learning (CSSL) framework for simultaneously learning diverse features from multi-window-obtained chest computed tomography (CT) images and ensuring data privacy. Achieving a robust and highly generalizable model in medical image diagnosis is challenging, mainly because of issues, such as the scarcity of large-scale, accurately annotated datasets and domain shifts inherent to dynamic healthcare environments. Specifically, in chest CT, these domain shifts often arise from differences in window settings, which are optimized for distinct clinical purposes. Previous CSSL frameworks often mitigated domain shift by reusing past data, a typically impractical approach owing to privacy constraints. Our approach addresses these challenges by effectively capturing the relationship between previously learned knowledge and new information across different training stages through continual pretraining on unlabeled images. Specifically, by incorporating a latent replay-based mechanism into CSSL, our method mitigates catastrophic forgetting due to domain shifts during continual pretraining while ensuring data privacy. Additionally, we introduce a feature distillation technique that integrates Wasserstein distance-based knowledge distillation (WKD) and batch-knowledge ensemble (BKE), enhancing the ability of the model to learn meaningful, domain-shift-robust representations. Finally, we validate our approach using chest CT images obtained across two different window settings, demonstrating superior performance compared with other approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。