提出新损失与网络,提升医疗图像分割的少样本学习能力。
Lagrange Duality and Compound Multi-Attention Transformer for Semi-Supervised Medical Image Segmentation
- 用拉格朗日对偶一致性损失缓解标注数据长尾问题
- 新网络CMAformer融合空间与通道注意力,实现多尺度特征融合
- 在多个公开数据集上达到当前最优,适合医疗视觉研究者
医疗图像分割是医疗健康领域语义分割的关键应用,近年来借助专用计算机视觉技术取得了显著进展。尽管基于深度学习的医学图像分割对辅助诊断至关重要,但训练数据多样性不足导致长尾问题。此外,以往大多数混合CNN-ViT架构在不同层间整合多种注意力机制的能力有限。为此,我们提出拉格朗日对偶一致性(LDC)损失,并结合边界感知对比损失,作为半监督学习的整体训练目标,以缓解长尾问题。同时,我们引入CMAformer,一种结合ResUNet与Transformer优势的新网络。CMAformer中的交叉注意力模块有效整合了空间注意力与通道注意力,实现多尺度特征融合。总体而言,我们的实验表明,CMAformer结合特征融合框架与新型一致性损失,在半监督学习集成中展现出强互补性。我们在多个公开医学图像数据集上取得了当前最优结果。示例代码已公开于:\url{https://github.com/lzeeorno/Lagrange-Duality-and-CMAformer}。
原文摘要 · Abstract (English)
Medical image segmentation, a critical application of semantic segmentation in healthcare, has seen significant advancements through specialized computer vision techniques. While deep learning-based medical image segmentation is essential for assisting in medical diagnosis, the lack of diverse training data causes the long-tail problem. Moreover, most previous hybrid CNN-ViT architectures have limited ability to combine various attentions in different layers of the Convolutional Neural Network. To address these issues, we propose a Lagrange Duality Consistency (LDC) Loss, integrated with Boundary-Aware Contrastive Loss, as the overall training objective for semi-supervised learning to mitigate the long-tail problem. Additionally, we introduce CMAformer, a novel network that synergizes the strengths of ResUNet and Transformer. The cross-attention block in CMAformer effectively integrates spatial attention and channel attention for multi-scale feature fusion. Overall, our results indicate that CMAformer, combined with the feature fusion framework and the new consistency loss, demonstrates strong complementarity in semi-supervised learning ensembles. We achieve state-of-the-art results on multiple public medical image datasets. Example code are available at: \url{https://github.com/lzeeorno/Lagrange-Duality-and-CMAformer}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。