解决医疗影像分割持续学习中的遗忘问题,通过双对齐机制保留历史知识。
Dual-Alignment Knowledge Retention for Continual Medical Image Segmentation
- 设计双对齐策略:跨网络与跨表示特征对齐
- 在域偏移下显著降低灾难性遗忘,提升长期性能
- 适合需要长期迭代训练的医疗影像分析场景
医疗图像分割的持续学习涉及在不同领域(如临床机构)中顺序获取数据,过去与当前领域的任务干扰常导致灾难性遗忘。现有方法难以捕捉任务间的复杂依赖关系。本文提出一种新框架,通过建立并增强历史数据与当前网络之间的复杂依赖来缓解遗忘。该框架包含双对齐策略:跨网络对齐(CNA)模块对齐当前与先前网络瓶颈层提取的特征;跨表示对齐(CRA)模块对齐当前网络从历史缓冲数据和当前输入数据中学习到的特征。为实现这两种对齐,我们深入分析了希尔伯特-施密特独立性准则(HSIC)的线性和非线性形式,并在CRA模块中精心设计了特征映射与特征配对模块。在医学图像分割任务上的实验表明,该框架在域偏移条件下有效缓解了灾难性遗忘。
原文摘要 · Abstract (English)
Continual learning in medical image segmentation involves sequential data acquisition across diverse domains (e.g., clinical sites), where task interference between past and current domains often leads to catastrophic forgetting. Existing continual learning methods fail to capture the complex dependencies between tasks. We introduce a novel framework that mitigates forgetting by establishing and enhancing complex dependencies between historical data and the network in the present task. Our framework features a dual-alignment strategy, the cross-network alignment (CNA) module aligns the features extracted from the bottleneck layers of the current and previous networks, respectively, while the cross-representation alignment (CRA) module aligns the features learned by the current network from historical buffered data and current input data, respectively. Implementing both types of alignment is a non-trivial task. To address this, we further analyze the linear and nonlinear forms of the well-established Hilbert-Schmidt Independence Criterion (HSIC) and deliberately design feature mapping and feature pairing blocks within the CRA module. Experiments on medical image segmentation task demonstrate our framework's effectiveness in mitigating catastrophic forgetting under domain shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。