新模型精准分割细长人体结构,无需复杂后处理
CSWinUNETR: Segmentation of Thin Anatomical Structures in Medical Images

- 用十字形注意力捕捉长程主轴信息,提升连续性
- 在4个医学图像数据集上均超越现有方法
- 适合眼科、脑血管、皮肤等细结构分割任务
细长解剖结构(如视网膜血管、脑血管、面部皱纹)的精准分割因对比度低、频繁中断和严重类别不平衡而困难。尽管近期卷积与Transformer模型性能有所提升,但仍常产生碎片化预测,难以恢复细分支。我们提出CSWinUNETR,一种通用的2D/3D细结构分割骨干网络。该模型采用十字形条带自注意力机制,建模长距离主轴上下文,并引入循环移位增强条带间信息交换。为更好保留细粒度细节,进一步设计了细节增强多尺度自注意力模块,从多分辨率表示中聚合上下文特征。此外,提出稀疏控制动态蛇形卷积,通过稀疏预测的控制点重构可靠的稠密曲线卷积核,以更好拟合曲折几何。在眼科、神经血管成像和皮肤病学四个基准上的大量实验表明,CSWinUNETR在不依赖任务特定后处理或拓扑感知损失的情况下,持续优于当前最先进方法。代码已开源:https://github.com/labhai/CSWinUNETR。
原文摘要 · Abstract (English)
Accurate segmentation of thin, tortuous anatomical structures, such as retinal vessels, cerebral vasculature, and facial wrinkles, remains challenging due to low contrast, frequent discontinuities, and severe class imbalance. Although recent convolutional and Transformer-based models have improved performance, they often yield fragmented predictions and fail to recover fine branches. We propose CSWinUNETR, a general-purpose backbone for 2D and 3D thin-structure segmentation. It employs cross-shaped stripe self-attention to model long-range principal-axis context and incorporates cyclic shifts to enhance information exchange across stripes. To better preserve fine-grained details, we further introduce a detail-enhanced multi-scale self-attention module that aggregates contextual features from multi-resolution representations. In addition, we propose sparse-control dynamic snake convolution, which reconstructs reliable dense curvilinear kernels from sparsely predicted control points to better follow tortuous geometry. Extensive experiments on four benchmarks across ophthalmology, neurovascular imaging, and dermatology demonstrate that CSWinUNETR consistently outperforms state-of-the-art methods without task-specific post-processing or topology-aware losses. The code is available at https://github.com/labhai/CSWinUNETR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。