提出多标签体素对比框架,解决3D脑图像单样本增量分割中旧知识遗忘问题。
MultiCo3D: Multi-Label Voxel Contrast for One-Shot Incremental Segmentation of 3D Neuroimages
- 设计多标签体素对比机制,缓解新旧白质束特征重叠问题。
- 在HCP和Preto数据集上,5种设置下分割准确率显著提升。
- 适合需持续学习新脑区的神经影像分析研究者使用。
3D神经影像为大脑结构与功能提供了全面视图,有助于精确定位和功能连接分析。利用3D神经影像对白质(WM)束进行分割,对于理解健康与疾病状态下大脑的结构连接至关重要。单样本类别增量语义分割(OCIS)指仅用一个样本即可有效分割新类别,同时保留旧类别的知识而不发生遗忘。基于体素对比的OCIS方法通过调整特征空间来缓解基类与新类之间的特征重叠问题。然而,由于白质束分割属于多标签分割任务,现有单标签体素对比方法存在内在矛盾。为此,我们提出一种新的多标签体素对比框架MultiCo3D,用于单样本增量束分割。该方法采用不确定性蒸馏保留基类分割知识,结合多标签体素对比调整特征空间以缓解学习新束时的特征重叠,并动态加权多损失以平衡总体损失。我们在多个SOTA方法上进行了对比实验,结果表明,在HCP和Preto数据集上,五种不同实验设置下,本方法显著提升了单样本增量束分割的准确率。
原文摘要 · Abstract (English)
3D neuroimages provide a comprehensive view of brain structure and function, aiding in precise localization and functional connectivity analysis. Segmentation of white matter (WM) tracts using 3D neuroimages is vital for understanding the brain's structural connectivity in both healthy and diseased states. One-shot Class Incremental Semantic Segmentation (OCIS) refers to effectively segmenting new (novel) classes using only a single sample while retaining knowledge of old (base) classes without forgetting. Voxel-contrastive OCIS methods adjust the feature space to alleviate the feature overlap problem between the base and novel classes. However, since WM tract segmentation is a multi-label segmentation task, existing single-label voxel contrastive-based methods may cause inherent contradictions. To address this, we propose a new multi-label voxel contrast framework called MultiCo3D for one-shot class incremental tract segmentation. Our method utilizes uncertainty distillation to preserve base tract segmentation knowledge while adjusting the feature space with multi-label voxel contrast to alleviate feature overlap when learning novel tracts and dynamically weighting multi losses to balance overall loss. We compare our method against several state-of-the-art (SOTA) approaches. The experimental results show that our method significantly enhances one-shot class incremental tract segmentation accuracy across five different experimental setups on HCP and Preto datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。