BEVANet通过双路高效注意力机制,实现实时语义分割并精准捕捉边缘细节。
BEVANet: Bilateral Efficient Visual Attention Network for Real-Time Semantic Segmentation
- 采用大核注意力与稀疏分解结构,兼顾上下文感知与计算效率。
- 在Cityscapes上达到81.0% mIoU(预训练后),33 FPS实时推理。
- 适合追求高精度与低延迟的嵌入式视觉系统部署。
实时语义分割面临两大挑战:设计能捕捉大感受野以实现语义理解的高效架构,同时精细还原轮廓。视觉变压器虽能有效建模长距离依赖,但计算开销高。为此,本文提出大核注意力(LKA)机制。所提出的双路高效视觉注意力网络(BEVANet)通过稀疏分解大可分离核注意力(SDLSKA)扩展感受野,提取视觉与结构特征;综合核选择(CKS)机制动态适应感受野以提升性能;深层大核金字塔池化模块(DLKPPM)通过空洞卷积与大核注意力协同增强上下文特征。双路结构促进分支间频繁交互,边界引导自适应融合(BGAF)模块在边界引导下整合空间与语义特征,提升边界清晰度。BEVANet实现33 FPS实时分割,在无预训练下达79.3% mIoU,预训练后在Cityscapes上达81.0% mIoU,性能达当前最优。代码与模型已开源。
原文摘要 · Abstract (English)
Real-time semantic segmentation presents the dual challenge of designing efficient architectures that capture large receptive fields for semantic understanding while also refining detailed contours. Vision transformers model long-range dependencies effectively but incur high computational cost. To address these challenges, we introduce the Large Kernel Attention (LKA) mechanism. Our proposed Bilateral Efficient Visual Attention Network (BEVANet) expands the receptive field to capture contextual information and extracts visual and structural features using Sparse Decomposed Large Separable Kernel Attentions (SDLSKA). The Comprehensive Kernel Selection (CKS) mechanism dynamically adapts the receptive field to further enhance performance. Furthermore, the Deep Large Kernel Pyramid Pooling Module (DLKPPM) enriches contextual features by synergistically combining dilated convolutions and large kernel attention. The bilateral architecture facilitates frequent branch communication, and the Boundary Guided Adaptive Fusion (BGAF) module enhances boundary delineation by integrating spatial and semantic features under boundary guidance. BEVANet achieves real-time segmentation at 33 FPS, yielding 79.3% mIoU without pretraining and 81.0% mIoU on Cityscapes after ImageNet pretraining, demonstrating state-of-the-art performance. The code and model is available at https://github.com/maomao0819/BEVANet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。