arXiv:2410.02528cs.CV2024-10被引 8

提升肠息肉分割精度,专注捕捉边缘等高频细节

HiFiSeg: High-Frequency Information Enhanced Polyp Segmentation with Global-Local Vision Transformer

  • 采用全局-局部视觉变压器架构,融合多尺度特征
  • 在CVC-ColonDB和ETIS数据集上mDice达0.826和0.822
  • 适合需要精准边界分割的医学图像分析任务

众多研究已证实基于视觉变压器(ViT)的方法在各类计算机视觉任务中表现优异。然而,ViT模型往往难以有效捕捉图像中的高频成分,而这些成分对于检测小目标和保持边缘细节至关重要,尤其在复杂场景下。这一局限性在结肠息肉分割任务中尤为突出,因为息肉在结构、纹理和形状上具有显著差异。高频信息(如边界细节)对实现精确语义分割至关重要。为此,我们提出HiFiSeg,一种新型结肠息肉分割网络,通过全局-局部视觉变压器框架增强高频信息处理能力。该方法以金字塔视觉变压器(PVT)为编码器,引入两个关键模块:全局-局部交互模块(GLIM)和选择性聚合模块(SAM)。GLIM采用并行结构,在多尺度下融合全局与局部信息,有效捕获细粒度特征;SAM则选择性地将低层特征中的边界细节与高层特征中的语义信息融合,显著提升模型对息肉的准确检测与分割能力。在五个广泛认可的基准数据集上的大量实验表明,该方法在息肉分割任务中具有卓越性能。特别地,在具有挑战性的CVC-ColonDB和ETIS数据集上,平均骰子系数(mDice)分别达到0.826和0.822,充分体现了其在应对此类任务特有复杂性方面的优势。

原文摘要 · Abstract (English)

Numerous studies have demonstrated the strong performance of Vision Transformer (ViT)-based methods across various computer vision tasks. However, ViT models often struggle to effectively capture high-frequency components in images, which are crucial for detecting small targets and preserving edge details, especially in complex scenarios. This limitation is particularly challenging in colon polyp segmentation, where polyps exhibit significant variability in structure, texture, and shape. High-frequency information, such as boundary details, is essential for achieving precise semantic segmentation in this context. To address these challenges, we propose HiFiSeg, a novel network for colon polyp segmentation that enhances high-frequency information processing through a global-local vision transformer framework. HiFiSeg leverages the pyramid vision transformer (PVT) as its encoder and introduces two key modules: the global-local interaction module (GLIM) and the selective aggregation module (SAM). GLIM employs a parallel structure to fuse global and local information at multiple scales, effectively capturing fine-grained features. SAM selectively integrates boundary details from low-level features with semantic information from high-level features, significantly improving the model's ability to accurately detect and segment polyps. Extensive experiments on five widely recognized benchmark datasets demonstrate the effectiveness of HiFiSeg for polyp segmentation. Notably, the mDice scores on the challenging CVC-ColonDB and ETIS datasets reached 0.826 and 0.822, respectively, underscoring the superior performance of HiFiSeg in handling the specific complexities of this task.

医学图像分割视觉变压器边缘增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。