改进U-Net的上下文感知与注意力机制,提升图像分割精度。
MSCA-UNet: Multi-Scale Context and Attention U-Net for Image Segmentation

- 在瓶颈层引入多尺度空洞卷积捕获多尺度上下文。
- 在解码器使用注意力模块重校准关键通道和空间位置特征。
- 结合两者使mIoU达99.1%,显著优于基线模型。
U-Net因其简洁的编码器-解码器结构和跳跃连接,仍是图像分割的实用基准。然而,其瓶颈层仍受限于有限的感受野,解码器特征传播也未显式强调最具信息量的通道和空间位置。本文提出MSCA-UNet,一种基于U-Net的分割架构,结合瓶颈处的多尺度上下文聚合与解码器中的通道-空间注意力精炼。多尺度模块采用并行空洞卷积,在不同感受野下捕捉上下文特征;卷积块注意力模块(CBAM)则逐步重校准解码器特征。在相同实验设置下,基线U-Net在测试集上mIoU为96.9%。加入多尺度上下文后提升至97.5%,仅用注意力则达98.4%。两者结合可实现99.1% mIoU,相比基线提升2.2个百分点。参数分析显示,仅注意力变体增加约0.044M参数,而多尺度模块贡献了主要模型容量增量。结果表明,多尺度上下文增强与注意力特征精炼在U-Net框架内具有互补优势。
原文摘要 · Abstract (English)
U-Net remains a practical baseline for image segmentation because of its simple encoder-decoder structure and skip connections. However, the bottleneck representation is still dominated by a limited set of receptive fields, while decoder features are propagated without explicitly emphasizing the most informative channels and spatial locations. This paper presents MSCA-UNet, a U-Net-based segmentation architecture that combines multi-scale contextual aggregation at the bottleneck with channel-spatial attention refinement in the decoder. The multi-scale module uses parallel atrous convolutions to capture contextual features at different receptive fields, while Convolutional Block Attention Modules (CBAMs) progressively recalibrate decoder features. Under identical experimental settings, the baseline U-Net achieves 96.9% mIoU on a held-out test set. Adding multi-scale context improves mIoU to 97.5%, while attention alone reaches 98.4%. Combining both mechanisms yields 99.1% mIoU, a 2.2 percentage-point improvement over the baseline. Parameter analysis further shows that the attention-only variant adds approximately 0.044M parameters, whereas the multi-scale module contributes most of the additional model capacity. The results support the view that multi-scale context enrichment and attention-based feature refinement provide complementary benefits within a U-Net framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。