轻量级架构融合卷积与注意力,高效分割遥感影像地表覆盖。
LALE: Lightweight-Transformer Architecture for Land-Cover Estimation

- encoder按分辨率分叉:浅层用卷积抓局部细节,深层用变换器捕全局上下文。
- 参数仅160万,比最优基线少4.5倍,推理速度提升1.8倍。
- 适合资源受限场景的遥感图像语义分割任务,兼顾精度与效率。
遥感影像语义分割需在严格计算预算下同时捕捉全局上下文与局部细节。现有方法通常侧重其一:注意力模型关注全局,卷积网络擅长局部,或追求紧凑性以提升效率。虽有混合方法尝试兼顾二者,但常需修改架构或使用高计算开销的编码器,限制了性能与效率。本文提出LALE(轻量级变换器架构用于地表覆盖估计),一种端到端的遥感图像分割架构,其编码器按分辨率分叉:轻量级ConvMixer阶段处理高分辨率局部特征,变换器阶段处理低分辨率全局上下文,将自注意力的二次方计算成本限制在深度下采样特征图上。配合全MLP多尺度解码器、RMSNorm与StarReLU,进一步降低计算量与参数量。在大规模ARAS400k遥感分割基准上,LALE在效率-性能权衡上优于CNN、Transformer及混合基线。最小变体仅160万参数,距离最佳基线UPerNet的F1值仅差2.6点,但参数减少4.5倍,存储降低7倍,GMACs减少17倍,吞吐量提升1.8倍。代码已开源于https://github.com/caglarmert/LALE。
原文摘要 · Abstract (English)
Semantic segmentation of remote sensing imagery requires models that capture both global context and local detail under tight computational budgets. Prior work typically optimizes for one of these axes: attention for global context, convolution for local detail, or compactness for efficiency. While hybrid approaches aim to capture both, they require architectural changes and encoder backbones with computational overhead, limiting efficiency and performance. We present LALE (Lightweight-transformer Architecture for Land-cover Estimation), an end-to-end remote sensing image segmentation architecture, that bifurcates its encoder by resolution: lightweight ConvMixer stages handle high-resolution local features, while transformer stages handle low-resolution global context, confining the quadratic cost of self-attention to deep, downsampled feature maps. An all-MLP multi-scale decoder, together with RMSNorm and StarReLU throughout, further reduces compute and parameter count. On the large-scale ARAS400k remote-sensing segmentation benchmark, LALE establishes a strong efficiency-performance trade-off against CNN, transformer, and hybrid baselines. Our smallest variant, (just 1.6M parameters), reaches within 2.6 F1 points of the best baseline (UPerNet) while using 4.5x fewer parameters, 7x less storage, 17x fewer GMACs, and delivering 1.8x higher throughput. The codebase for LALE is publicly available at https://github.com/caglarmert/LALE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。