轻量级解码器LightFormer高效分割遥感图像中的不规则目标。
LightFormer: A lightweight and efficient decoder for remote sensing image segmentation
- 基于通道处理与可学习门控的特征融合模块,降低模型复杂度。
- 在Vaihingen上达83.9% mIoU,仅需14.7%的计算量和15.9%参数。
- 适合边缘设备部署,尤其适用于灾情评估等实时场景。
深度学习在遥感图像语义分割和土地利用变化检测中表现卓越,但其在边缘平台的实时部署受限于解码器复杂度。本文提出LightFormer,一种面向灾情评估、无人机搜救、文化遗产监测等需处理非结构化目标的时敏任务的轻量级解码器。该方法通过基于通道处理的特征融合与精炼模块,结合可学习门控机制,高效聚合多尺度、多范围信息,显著降低模型复杂度。进一步提出空间信息选择模块(SISM),融合长程注意力与细节保留分支,有效捕捉多尺度空间依赖,大幅提升复杂场景下非结构化目标的识别能力。在ISPRS Vaihingen基准上,LightFormer达到83.9% mIoU,为GLFFNet的99.9%,而仅需14.7%的FLOPs与15.9%的参数,实现优异的精度-效率平衡。在LoveDA、ISPRS Potsdam、RescueNet与FloodNet上的一致结果验证了其鲁棒性与对非结构化物体的优越感知能力。研究表明,LightFormer是遥感应用中兼具计算经济性与高精度分割的理想方案。
原文摘要 · Abstract (English)
Deep learning techniques have achieved remarkable success in the semantic segmentation of remote sensing images and in land-use change detection. Nevertheless, their real-time deployment on edge platforms remains constrained by decoder complexity. Herein, we introduce LightFormer, a lightweight decoder for time-critical tasks that involve unstructured targets, such as disaster assessment, unmanned aerial vehicle search-and-rescue, and cultural heritage monitoring. LightFormer employs a feature-fusion and refinement module built on channel processing and a learnable gating mechanism to aggregate multi-scale, multi-range information efficiently, which drastically curtails model complexity. Furthermore, we propose a spatial information selection module (SISM) that integrates long-range attention with a detail preservation branch to capture spatial dependencies across multiple scales, thereby substantially improving the recognition of unstructured targets in complex scenes. On the ISPRS Vaihingen benchmark, LightFormer attains 99.9% of GLFFNet's mIoU (83.9% vs. 84.0%) while requiring only 14.7% of its FLOPs and 15.9% of its parameters, thus achieving an excellent accuracy-efficiency trade-off. Consistent results on LoveDA, ISPRS Potsdam, RescueNet, and FloodNet further demonstrate its robustness and superior perception of unstructured objects. These findings highlight LightFormer as a practical solution for remote sensing applications where both computational economy and high-precision segmentation are imperative.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。