HiPerformer通过模块化分层融合提升医学图像分割精度。
HiPerformer: A High-Performance Global-Local Segmentation Model with Modular Hierarchical Fusion Strategy
- 采用模块化分层架构并行融合多源特征,实现深度信息整合。
- 在11个公开数据集上表现优于现有方法,显著提升分割准确率与鲁棒性。
- 适合需要高精度医学图像分割的研究者和临床应用开发者。
医学图像分割中,局部细节与全局上下文均至关重要,有效融合二者对实现高精度分割至关重要。然而,现有基于CNN-Transformer混合架构的方法通常采用串行堆叠、端点拼接或逐点相加等简单特征融合方式,难以解决特征不一致问题,易引发信息冲突与丢失。为此,我们提出HiPerformer。其编码器采用新颖的模块化分层架构,动态并行融合多源特征,实现层级式深度信息整合。该设计不仅保留各分支独立建模能力,还确保层间充分信息传递,有效避免传统堆叠方法导致的特征退化与信息丢失。此外,我们设计了局部-全局特征融合(LGFF)模块,实现局部细节与全局语义信息的精确高效融合,有效缓解特征不一致问题,获得更全面的特征表示。为进一步增强多尺度特征表达能力并抑制噪声干扰,我们提出渐进式金字塔聚合(PPA)模块,替代传统跳跃连接。在11个公开数据集上的实验表明,所提方法优于现有分割技术,展现出更高的分割精度与鲁棒性。代码已开源:https://github.com/xzphappy/HiPerformer。
原文摘要 · Abstract (English)
Both local details and global context are crucial in medical image segmentation, and effectively integrating them is essential for achieving high accuracy. However, existing mainstream methods based on CNN-Transformer hybrid architectures typically employ simple feature fusion techniques such as serial stacking, endpoint concatenation, or pointwise addition, which struggle to address the inconsistencies between features and are prone to information conflict and loss. To address the aforementioned challenges, we innovatively propose HiPerformer. The encoder of HiPerformer employs a novel modular hierarchical architecture that dynamically fuses multi-source features in parallel, enabling layer-wise deep integration of heterogeneous information. The modular hierarchical design not only retains the independent modeling capability of each branch in the encoder, but also ensures sufficient information transfer between layers, effectively avoiding the degradation of features and information loss that come with traditional stacking methods. Furthermore, we design a Local-Global Feature Fusion (LGFF) module to achieve precise and efficient integration of local details and global semantic information, effectively alleviating the feature inconsistency problem and resulting in a more comprehensive feature representation. To further enhance multi-scale feature representation capabilities and suppress noise interference, we also propose a Progressive Pyramid Aggregation (PPA) module to replace traditional skip connections. Experiments on eleven public datasets demonstrate that the proposed method outperforms existing segmentation techniques, demonstrating higher segmentation accuracy and robustness. The code is available at https://github.com/xzphappy/HiPerformer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。