融合频域信息与多尺度对齐,提升结肠镜下息肉分割精度。
PSTNet: Enhanced Polyp Segmentation with Multi-scale Alignment and Frequency Domain Integration
- 引入频域特征与多尺度对齐模块,增强图像细节感知。
- 在CVC-ClinicDB等数据集上达到93.2%的Dice分数,优于现有方法。
- 适合医学图像分割研究者及临床辅助诊断系统开发者。
结肠镜图像中结肠息肉的精确分割对于结直肠癌(CRC)的有效诊断与管理至关重要。然而,当前基于深度学习的方法主要依赖多尺度RGB信息融合,受限于RGB域信息且在多尺度特征聚合时存在特征错位问题。为此,我们提出一种新型网络PSTNet,整合图像中的RGB与频域线索。PSTNet包含三个关键模块:频率特征注意力模块(FCAM)用于提取频域特征并捕捉息肉特性;特征补全对齐模块(FSAM)用于对齐语义信息、减少错位噪声;跨感知定位模块(CPM)用于协同频域特征与高层语义,实现高效息肉分割。在多个挑战性数据集上的大量实验表明,PSTNet在各类指标上显著提升分割精度,持续优于现有最优方法。频域线索的引入与PSTNet的创新架构设计推动了计算机辅助息肉分割的发展,有助于更精准的CRC诊断与管理。
原文摘要 · Abstract (English)
Accurate segmentation of colorectal polyps in colonoscopy images is crucial for effective diagnosis and management of colorectal cancer (CRC). However, current deep learning-based methods primarily rely on fusing RGB information across multiple scales, leading to limitations in accurately identifying polyps due to restricted RGB domain information and challenges in feature misalignment during multi-scale aggregation. To address these limitations, we propose the Polyp Segmentation Network with Shunted Transformer (PSTNet), a novel approach that integrates both RGB and frequency domain cues present in the images. PSTNet comprises three key modules: the Frequency Characterization Attention Module (FCAM) for extracting frequency cues and capturing polyp characteristics, the Feature Supplementary Alignment Module (FSAM) for aligning semantic information and reducing misalignment noise, and the Cross Perception localization Module (CPM) for synergizing frequency cues with high-level semantics to achieve efficient polyp segmentation. Extensive experiments on challenging datasets demonstrate PSTNet's significant improvement in polyp segmentation accuracy across various metrics, consistently outperforming state-of-the-art methods. The integration of frequency domain cues and the novel architectural design of PSTNet contribute to advancing computer-assisted polyp segmentation, facilitating more accurate diagnosis and management of CRC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。