通过自增强语义模块提升结肠镜图像中息肉分割精度
Polyp-SES: Automatic Polyp Segmentation with Self-Enriched Semantic Model
- 引入自增强语义模块,动态挖掘深层特征中的额外语义信息
- 在5个基准数据集上优于当前最优方法,尤其在泛化能力上表现突出
- 适合医学图像分割研究者及临床辅助诊断系统开发者
自动息肉分割对结肠镜图像的精准诊断与治疗至关重要。传统方法受限于特征表达能力及对息肉外观多样性的处理,难以准确勾勒息肉边界。尽管深度学习技术(如CNN和Transformer)已被用于提升分割精度,但现有方法常忽略额外语义信息,限制了模型对息肉上下文的理解。本文提出一种名为「Polyp-SES」的新方法,首先从输入图像提取特征序列并解码生成初始分割掩码;随后,通过自增强语义模块查询潜在语义,并将补充语义注入深层特征,从而增强模型对上下文的感知能力。大量实验表明,该方法在五个息肉分割基准数据集上均显著优于现有先进方法,在性能与泛化能力方面均有明显提升。
原文摘要 · Abstract (English)
Automatic polyp segmentation is crucial for effective diagnosis and treatment in colonoscopy images. Traditional methods encounter significant challenges in accurately delineating polyps due to limitations in feature representation and the handling of variability in polyp appearance. Deep learning techniques, including CNN and Transformer-based methods, have been explored to improve polyp segmentation accuracy. However, existing approaches often neglect additional semantics, restricting their ability to acquire adequate contexts of polyps in colonoscopy images. In this paper, we propose an innovative method named ``Automatic Polyp Segmentation with Self-Enriched Semantic Model'' to address these limitations. First, we extract a sequence of features from an input image and decode high-level features to generate an initial segmentation mask. Using the proposed self-enriched semantic module, we query potential semantics and augment deep features with additional semantics, thereby aiding the model in understanding context more effectively. Extensive experiments show superior segmentation performance of the proposed method against state-of-the-art polyp segmentation baselines across five polyp benchmarks in both superior learning and generalization capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。