用双路编码融合视觉大模型,提升冠状动脉分割精度
Unleashing Vision Foundation Models for Coronary Artery Segmentation: Parallel ViT-CNN Encoding and Variational Fusion
- 并行使用ViT捕捉全局结构,CNN提取局部细节
- 跨分支变分融合模块使分割Dice达0.896
- 适合医学图像分割研究者和临床辅助诊断开发
准确的冠状动脉分割对冠心病辅助诊断至关重要,但受限于血管细小、形态复杂及与周围组织对比度低等挑战。为此,我们提出一种新型分割框架,利用视觉基础模型(VFMs)的并行编码架构:在VFMs中,视觉变换器(ViT)编码器通过激活最后两层块并结合注意力引导增强(AGE)模块捕捉全局结构特征;同时,卷积神经网络(CNN)编码器提取局部细节。两者互补特征通过交叉分支变分融合(CVF)模块自适应融合,该模块建模潜在分布并应用变分注意力分配模态特定权重。此外,引入证据学习不确定性精炼(EUR)模块,基于证据理论量化不确定性,并通过多尺度特征聚合与注意力机制优化不确定区域,进一步提升分割精度。在1个自有数据集和2个公开数据集上的大量实验表明,所提框架显著优于现有方法,在多个数据集上展现优异性能与强泛化能力。代码已开源:https://github.com/d1c2x3/CAseg。
原文摘要 · Abstract (English)
Accurate coronary artery segmentation is critical for computeraided diagnosis of coronary artery disease (CAD), yet it remains challenging due to the small size, complex morphology, and low contrast with surrounding tissues. To address these challenges, we propose a novel segmentation framework that leverages the power of vision foundation models (VFMs) through a parallel encoding architecture. Specifically, a vision transformer (ViT) encoder within the VFM captures global structural features, enhanced by the activation of the final two ViT blocks and the integration of an attention-guided enhancement (AGE) module, while a convolutional neural network (CNN) encoder extracts local details. These complementary features are adaptively fused using a cross-branch variational fusion (CVF) module, which models latent distributions and applies variational attention to assign modality-specific weights. Additionally, we introduce an evidential-learning uncertainty refinement (EUR) module, which quantifies uncertainty using evidence theory and refines uncertain regions by incorporating multi-scale feature aggregation and attention mechanisms, further enhancing segmentation accuracy. Extensive evaluations on one in-house and two public datasets demonstrate that the proposed framework significantly outperforms state-of-the-art methods, achieving superior performance in accurate coronary artery segmentation and showcasing strong generalization across multiple datasets. The code is available at https://github.com/d1c2x3/CAseg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。