融合CNN与Mamba,提升视网膜血管分割精度与连续性。
A Novel Hybrid Approach for Retinal Vessel Segmentation with Dynamic Long-Range Dependency and Multi-Scale Retinal Edge Fusion Enhancement
- 用多尺度边缘融合模块增强血管边界特征
- 动态蛇形状态空间块捕捉长程依赖和弯曲细节
- 在低对比度区域仍保持高精度,适合临床应用
精准的视网膜血管分割为眼科图像分析提供关键结构信息。现有方法在多尺度血管变化、复杂曲率及模糊边界方面仍存挑战。尽管卷积神经网络(CNN)、基于Transformer的模型和Mamba架构已取得进展,但常出现血管断裂或边缘特征模糊问题。为此,本文提出一种新型混合框架,融合CNN与Mamba以实现高精度视网膜血管分割。创新点包括:1)高分辨率边缘融合网络结合多尺度主干与多尺度视网膜边缘融合(MREF)模块,保留高分辨率并强化边缘特征;2)动态蛇形视觉状态空间块将动态蛇形卷积与Mamba结合,通过八方向2D蛇形选择扫描机制和动态加权策略,自适应捕捉血管曲率与长程依赖;3)MREF模块通过多尺度边缘特征聚合,抑制噪声并突出跨尺度关键血管结构。在三个公开数据集上的实验表明,该方法达到当前最优性能,尤其在保持血管连续性和低对比度区域分割方面表现优异。代码已开源:https://github.com/frank-oy/HREFNet。
原文摘要 · Abstract (English)
Accurate retinal vessel segmentation provides essential structural information for ophthalmic image analysis. However, existing methods struggle with challenges such as multi-scale vessel variability, complex curvatures, and ambiguous boundaries. While Convolutional Neural Networks (CNNs), Transformer-based models and Mamba-based architectures have advanced the field, they often suffer from vascular discontinuities or edge feature ambiguity. To address these limitations, we propose a novel hybrid framework that synergistically integrates CNNs and Mamba for high-precision retinal vessel segmentation. Our approach introduces three key innovations: 1) The proposed High-Resolution Edge Fuse Network is a high-resolution preserving hybrid segmentation framework that combines a multi-scale backbone with the Multi-scale Retina Edge Fusion (MREF) module to enhance edge features, ensuring accurate and robust vessel segmentation. 2) The Dynamic Snake Visual State Space block combines Dynamic Snake Convolution with Mamba to adaptively capture vessel curvature details and long-range dependencies. An improved eight-directional 2D Snake-Selective Scan mechanism and a dynamic weighting strategy enhance the perception of complex vascular topologies. 3) The MREF module enhances boundary precision through multi-scale edge feature aggregation, suppressing noise while emphasizing critical vessel structures across scales. Experiments on three public datasets demonstrate that our method achieves state-of-the-art performance, particularly in maintaining vascular continuity and effectively segmenting vessels in low-contrast regions. This work provides a robust method for clinical applications requiring accurate retinal vessel analysis. The code is available at https://github.com/frank-oy/HREFNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。