用多分支卷积增强Swin的局部特征推理能力,提升小数据下的医学图像分割性能。
SwInception -- Local Attention Meets Convolutions
- 在Swin的前馈层引入Inception块,加强局部多尺度特征建模。
- 在11个医学数据集上实现性能提升,超越Medical Segmentation Decathlon等基准。
- 适合关注医学图像分割与稀疏视觉变换器优化的研究者。
稀疏视觉变换器因其高效性成为医学体数据分割的主流编码器,Swin凭借局部注意力机制表现出色,但在小数据集上仍易过拟合。为此,本文提出SwInception,在前馈层引入Inception块以增强模型归纳偏置。多分支卷积使变换器块能更直接地处理局部、多尺度特征。同时优化解码器结构,在减少参数量的同时捕捉更精细细节。在11个不同医学数据集上通过大量实验验证了性能提升,尤其在Medical Segmentation Decathlon和Beyond the Cranial Vault等基准挑战中优于先前最先进骨干网络。结果表明,Swin的现有归纳偏置可进一步优化,为稀疏视觉变换器在医学与自然图像分割中的应用提供了新路径。代码与预训练权重见https://github.com/Eiphodos/SwInception。
原文摘要 · Abstract (English)
Sparse vision transformers have gained popularity as efficient encoders for medical volumetric segmentation, with Swin emerging as a prominent choice. Swin uses local attention to reduce complexity and yields excellent performance for many tasks but still tends to overfit on small datasets. To mitigate this weakness, we propose a novel architecture that further enhances Swin's inductive bias by introducing Inception blocks in the feed-forward layers. The introduction of these multi-branch convolutions enables more direct reasoning over local, multi-scale features within the transformer block. We have also modified the decoder layers in order to capture finer details using fewer parameters. We demonstrate a performance improvement on eleven different medical datasets through extensive experimentation. We specifically showcase advancements over the previous state-of-the-art backbones on benchmark challenges like the Medical Segmentation Decathlon and Beyond the Cranial Vault. By showing that the existing inductive bias in Swin can be further improved, our work presents a promising avenue for enhancing the capabilities of sparse vision transformers for both medical and natural image segmentation tasks. Code and pre-trained weights can be accessed at https://github.com/Eiphodos/SwInception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。