用证据引导一致性增强模型对模糊超声图像的边缘分割能力
MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation
- 引入证据理论,利用高置信预测指导低置信边缘区域优化
- 构建混合CNN-Mamba架构,提升长距离依赖建模能力
- 适合弱监督超声图像分割,尤其擅长处理边缘模糊场景
超声图像分割有助于疾病评估。基于稀疏标注的弱监督学习(WSL)在降低标注成本方面展现出潜力。本研究将草图标注的WSL引入超声图像分割任务。然而,超声图像常存在对比度差、边缘不清的问题,且边缘监督信号不足,导致边缘预测困难。不确定性建模已被证明有助于缓解此类问题,但现有方法对决策边界附近的预测过度过滤,造成不稳定。为此,我们提出有效利用决策边界附近预测的方法:引入基于证据理论(DST)的证据引导一致性策略,利用高置信度预测(更可能出现在高密度区域)来指导低置信度预测(可能出现在决策边界附近)的优化。此外,超声图像中病灶大小和位置多样,传统卷积神经网络(CNN)因局部感受野难以建模全局信息。因此,我们引入基于结构化状态空间序列模型的视觉Mamba,以线性复杂度实现长程依赖建模,并构建新型混合CNN-Mamba框架。训练中,该框架通过证据引导一致性策略促进CNN分支与Mamba分支相互启发。实验表明所提方法具有竞争力。数据集与代码将公开于https://github.com/GtLinyer/MambaEviScrib。
原文摘要 · Abstract (English)
Segmenting anatomical structures and lesions from ultrasound images contributes to disease assessment. Weakly supervised learning (WSL) based on sparse annotation has achieved encouraging performance and demonstrated the potential to reduce annotation costs. This study attempts to introduce scribble-based WSL into ultrasound image segmentation tasks. However, ultrasound images often suffer from poor contrast and unclear edges, coupled with insufficient supervison signals for edges, posing challenges to edge prediction. Uncertainty modeling has been proven to facilitate models in dealing with these issues. Nevertheless, existing uncertainty estimation paradigms are not robust enough and often filter out predictions near decision boundaries, resulting in unstable edge predictions. Therefore, we propose leveraging predictions near decision boundaries effectively. Specifically, we introduce Dempster-Shafer Theory (DST) of evidence to design an Evidence-Guided Consistency strategy. This strategy utilizes high-evidence predictions, which are more likely to occur near high-density regions, to guide the optimization of low-evidence predictions that may appear near decision boundaries. Furthermore, the diverse sizes and locations of lesions in ultrasound images pose a challenge for CNNs with local receptive fields, as they struggle to model global information. Therefore, we introduce Visual Mamba based on structured state space sequence models, which achieves long-range dependency with linear computational complexity, and we construct a novel hybrid CNN-Mamba framework. During training, the collaboration between the CNN branch and the Mamba branch in the proposed framework draws inspiration from each other based on the EGC strategy. Experiments demonstrate the competitiveness of the proposed method. Dataset and code will be available on https://github.com/GtLinyer/MambaEviScrib.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。