FocusNet提升肠镜息肉分割精度,跨模态表现更稳定。
FocusNet: Transformer-enhanced Polyp Segmentation with Local and Pooling Attention
- 引入局部与池化注意力机制,融合全局上下文和细节特征。
- 在五种肠镜模态上均达90%以上Dice系数,最高达93.42%。
- 适用于多中心、多模态真实临床场景,适合医学图像分割研究者。
结肠镜检查对早期发现结直肠息肉至关重要,定期筛查可有效防止良性息肉进展为结直肠癌。尽管深度学习在息肉分割上取得显著进展,但多数模型仅基于单模态、单中心数据训练,在真实临床环境中表现有限。为此,我们提出FocusNet,一种基于Transformer增强的聚焦注意力网络,用于提升息肉分割性能。FocusNet包含三个核心模块:跨语义交互解码模块(CIDM)生成粗分割图,细节增强模块(DEM)优化浅层特征,聚焦注意力模块(FAM)通过局部与池化注意力平衡局部细节与全局上下文。我们在新提出的多模态、多中心数据集PolypDB上评估模型。大量实验表明,FocusNet在所有五种模态上均优于现有先进方法:在BLI模态上达到82.47%的Dice系数,FICE为88.46%,LCI为92.04%,NBI为82.09%,WLI为93.42%,展现出优异的准确性与跨模态鲁棒性。FocusNet源代码已公开于https://github.com/JunZengz/FocusNet。
原文摘要 · Abstract (English)
Colonoscopy is vital in the early diagnosis of colorectal polyps. Regular screenings can effectively prevent benign polyps from progressing to CRC. While deep learning has made impressive strides in polyp segmentation, most existing models are trained on single-modality and single-center data, making them less effective in real-world clinical environments. To overcome these limitations, we propose FocusNet, a Transformer-enhanced focus attention network designed to improve polyp segmentation. FocusNet incorporates three essential modules: the Cross-semantic Interaction Decoder Module (CIDM) for generating coarse segmentation maps, the Detail Enhancement Module (DEM) for refining shallow features, and the Focus Attention Module (FAM), to balance local detail and global context through local and pooling attention mechanisms. We evaluate our model on PolypDB, a newly introduced dataset with multi-modality and multi-center data for building more reliable segmentation methods. Extensive experiments showed that FocusNet consistently outperforms existing state-of-the-art approaches with a high dice coefficients of 82.47% on the BLI modality, 88.46% on FICE, 92.04% on LCI, 82.09% on the NBI and 93.42% on WLI modality, demonstrating its accuracy and robustness across five different modalities. The source code for FocusNet is available at https://github.com/JunZengz/FocusNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。