融合CNN与视觉变换器,提升医学图像分割的鲁棒性
TBConvL-Net: A Hybrid Deep Learning Architecture for Robust Medical Image Segmentation
- 结合CNN局部特征与视觉变换器全局依赖建模
- 在10个数据集上优于现有方法,显著提升分割精度
- 适合医学图像分析、疾病诊断等临床场景应用
深度学习在自动化医学图像分割中展现出巨大潜力,可提升疾病诊断的精准度与效率。然而,病灶在尺度、形状、纹理和对比度上的变化带来了显著挑战。传统卷积神经网络(CNN)在建模多尺度上下文信息及跨层级跳跃连接间的信息交互方面存在局限。为此,本文提出一种新型深度学习架构TBConvL-Net,融合CNN与视觉变换器(ViT),结合CNN编码器-解码器的局部特征提取能力,以及双卷积长短期记忆网络(Biconvolutional LSTM)和视觉变换器对长程与时间依赖性的建模。该结构可捕捉数据中的上下文通道关系,并处理分割结果的时间不确定性。此外,设计了一种新型复合损失函数,同时考虑分割鲁棒性与预测结果与金标准之间的边界一致性。实验表明,该模型在涵盖七种不同医学成像模态的十个公开数据集上均持续优于当前最先进方法。
原文摘要 · Abstract (English)
Deep learning has shown great potential for automated medical image segmentation to improve the precision and speed of disease diagnostics. However, the task presents significant difficulties due to variations in the scale, shape, texture, and contrast of the pathologies. Traditional convolutional neural network (CNN) models have certain limitations when it comes to effectively modelling multiscale context information and facilitating information interaction between skip connections across levels. To overcome these limitations, a novel deep learning architecture is introduced for medical image segmentation, taking advantage of CNNs and vision transformers. Our proposed model, named TBConvL-Net, involves a hybrid network that combines the local features of a CNN encoder-decoder architecture with long-range and temporal dependencies using biconvolutional long-short-term memory (LSTM) networks and vision transformers (ViT). This enables the model to capture contextual channel relationships in the data and account for the uncertainty of segmentation over time. Additionally, we introduce a novel composite loss function that considers both the segmentation robustness and the boundary agreement of the predicted output with the gold standard. Our proposed model shows consistent improvement over the state of the art on ten publicly available datasets of seven different medical imaging modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。