arXiv:2606.25324cs.CV2026-06

用线性复杂度模型实现高效遥感实例分割,性能超主流ViT。

Efficient Remote Sensing Instance Segmentation with Linear-Time State Space Distilled Visual Foundation Models

论文配图:Efficient Remote Sensing Instance Segmentation with Linear-Time State Space Distilled Visual Foundation Models
图 1 · 摘自论文原文
  • 通过知识蒸馏将ViT注意力空间压缩到轻量级状态空间模型
  • 参数减少8倍,计算量降低9倍,精度仍优于或媲美ViT/CNN
  • 适合需要高效推理的遥感图像分割场景,代码开源

Transformer的计算复杂度随标记数呈二次增长,严重制约了视觉模型效率,尤其在密集预测任务中。实例分割作为遥感领域典型密集预测任务,面临同样挑战。本文受大语言模型知识蒸馏启发,提出RS4D方法,采用线性复杂度状态空间建模(SSM),解决长序列建模效率问题。我们设计自适应噪声与掩码知识蒸馏训练策略,将大规模自注意力空间的知识有效压缩至紧凑的线性状态空间。构建基于该轻量编码器的遥感图像实例分割架构,对比三种骨干网络和两种分割头。在SSDD、WHU、NWPU等多个基准数据集上验证,相比基于ViT的方法,所提SSM骨干参数减少8倍,浮点运算量(FLOPs)降低9倍,同时保持相当或更优的精度。代码已公开于https://github.com/QinzheYang/RS4D。

原文摘要 · Abstract (English)

The computational complexity of Transformers scales quadratically with the number of tokens, which significantly constrains the efficiency of vision models, particularly recent ViT-based foundation models in dense prediction tasks. Instance segmentation, a typical dense visual prediction task in the remote sensing field, faces similar challenges. In this paper, inspired by the recent advances of knowledge distillation in large language models, we introduce RS4D - a new remote sensing instance segmentation method with linear computational complexity, which addresses the inefficiency of long sequence modeling through distilled state space modeling (SSM). We propose an adaptive noise and masking knowledge distillation training method for pre-training lightweight SSM backbones, which effectively compresses knowledge from the vast self-attention space into a compact, dense linear state space. We also design a remote sensing image instance segmentation architecture based on this lightweight visual encoder, where we explore variants of three different backbones and two segmentation heads. Extensive experiments are conducted on multiple benchmark datasets, including SSDD, WHU, and NWPU. Compared to ViT-based approaches, our proposed SSM backbone achieves an 8x reduction in parameters and a 9x reduction in FLOPs while maintaining comparable or superior accuracy to both ViT- and CNN-based instance segmentation methods. The implementation codes have been publicly available at https://github.com/QinzheYang/RS4D.

遥感分割状态空间模型知识蒸馏轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。