arXiv:2412.17241cs.CVcs.AI2024-12被引 1

提出QTSeg框架,用查询令牌融合局部与全局信息,提升医学图像分割精度与效率。

QTSeg: A Query Token-Based Dual-Mix Attention Framework with Multi-Level Feature Distribution for Medical Image Segmentation

  • 通过双混合注意力解码器融合跨注意力、空间与通道注意力,增强特征对齐与依赖建模。
  • 在五个数据集上超越主流方法,在保持低计算成本下实现更高分割准确率。
  • 适合需要高精度且高效运行的医学影像分析场景,如病灶与细胞分割。

医学图像分割在辅助临床诊断和实现自动化诊断中至关重要。传统卷积神经网络(CNN)难以捕捉长程依赖,而基于变压器的架构虽有效但计算开销大。近期研究尝试结合CNN与变压器以平衡性能与效率,但仍面临高精度与低成本难兼顾的问题,且多数方法未充分挖掘编码器的局部空间信息。为此,本文提出QTSeg,一种新型医学图像分割架构,能有效融合局部与全局信息。QTSeg采用双混合注意力解码器,包含:(1) 跨注意力机制提升特征对齐,(2) 空间注意力模块捕捉长程依赖,(3) 通道注意力块学习通道间关系。此外,引入多层级特征分布模块,自适应调节编码器与解码器间特征传播,进一步提升性能。在涵盖病灶、息肉、乳腺癌、细胞及视网膜血管分割等五项任务的公开数据集上进行广泛实验,结果表明,QTSeg在多个评估指标上优于现有最先进方法,同时保持较低计算成本。代码开源地址:https://github.com/tpnam0901/QTSeg (v1.0.0)。

原文摘要 · Abstract (English)

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing long-range dependencies, while transformer-based architectures, despite their effectiveness, come with increased computational complexity. Recent efforts have focused on combining CNNs and transformers to balance performance and efficiency, but existing approaches still face challenges in achieving high segmentation accuracy while maintaining low computational costs. Furthermore, many methods underutilize the CNN encoder's capability to capture local spatial information, concentrating primarily on mitigating long-range dependency issues. To address these limitations, we propose QTSeg, a novel architecture for medical image segmentation that effectively integrates local and global information. QTSeg features a dual-mix attention decoder designed to enhance segmentation performance through: (1) a cross-attention mechanism for improved feature alignment, (2) a spatial attention module to capture long-range dependencies, and (3) a channel attention block to learn inter-channel relationships. Additionally, we introduce a multi-level feature distribution module, which adaptively balances feature propagation between the encoder and decoder, further boosting performance. Extensive experiments on five publicly available datasets covering diverse segmentation tasks, including lesion, polyp, breast cancer, cell, and retinal vessel segmentation, demonstrate that QTSeg outperforms state-of-the-art methods across multiple evaluation metrics while maintaining lower computational costs. Our implementation can be found at: https://github.com/tpnam0901/QTSeg (v1.0.0)

医学图像分割注意力机制双混合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。