arXiv:2608.18979cs.CV2026-08中稿 · IEEE ICIP 2026

轻量级分割新框架,简单设计实现高效上下文建模

When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation

  • 在极低算力下,聚焦瓶颈层融合局部与全局信息
  • 在ADE20K等数据集上达到轻量模型最优精度-效率平衡
  • 适合资源受限场景的实时语义分割应用

语义分割需在精度、效率和可扩展性间取得平衡,尤其对高分辨率图像仍具挑战。卷积网络擅长建模局部模式,但难以捕捉长程依赖;视觉变换器虽能捕获全局上下文,却计算成本高昂。现有工作多关注编码器设计,而对关键的信息聚合与流动枢纽——瓶颈阶段则关注不足。本文提出SiConMo,包含两种变体:仅用RGB的SiConMo与引入GME增强的SiConMo$_\dagger$。我们发现,在极低计算预算下,瓶颈层是整合局部与全局上下文最高效的阶段。SiConMo集成三个互补组件:用于分层多尺度表示的令牌金字塔提取模块、面向瓶颈的变压器分支深度卷积块,以及保留空间结构并提升语义一致性的特征融合模块。在ADE20K、PASCAL Context、Cityscapes和COCO-Stuff上的大量实验表明,SiConMo在轻量级语义分割模型中实现了当前最优的精度-效率权衡,凸显了简洁设计的强大优势。

原文摘要 · Abstract (English)

Semantic segmentation demands a careful balance between accuracy, efficiency, and scalability, which remains difficult to achieve for high-resolution imagery. Convolutional networks effectively model local patterns but struggle with long-range dependencies, whereas Vision Transformers capture global context at a high computational cost. While recent work largely focuses on encoder design, the bottleneck stage, central to contextual aggregation and information flow, has been relatively overlooked. We propose SiConMo, a lightweight yet effective framework, implemented in two variants: an RGB-only model (SiConMo) and a GME-enhanced variant (SiConMo$_\dagger$). We show that simplicity arises from a key design principle: at very low computational budgets, the bottleneck is the most efficient stage to integrate local and global context. SiConMo integrates three complementary components: a Token Pyramid Extraction Module for hierarchical multi-scale representation, a Transformer-Branched Depthwise Convolution block for bottleneck-aware context modeling, and a Feature Merging Module that preserves spatial structure while enhancing semantic consistency. Extensive experiments on ADE20K, PASCAL Context, Cityscapes, and COCO-Stuff demonstrate that SiConMo achieves a state-of-the-art accuracy-efficiency trade-off among lightweight semantic segmentation models, highlighting simplicity as a powerful design principle.

语义分割轻量模型上下文建模Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。