arXiv:2506.14382cs.CVcs.AI2025-06

利用深度信息提升遥感图像语义分割精度,解决阴影与光谱混淆问题。

DepthSeg: Depth prompting in remote sensing semantic segmentation

  • 通过轻量级适配器微调预训练视觉变压器,高效提取遥感特征。
  • 设计深度提示模块,显式建模地物高程信息以增强分割鲁棒性。
  • 在柳州数据集上显著提升复杂场景下土地覆盖分类准确率,适合遥感应用者。

遥感语义分割对提取地表详细信息至关重要,广泛应用于环境监测、土地利用规划和资源评估。近年来,人工智能推动了自动遥感分割方法的发展,但现有方法主要关注物体的光谱特性,忽视了目标之间的高程差异,导致在存在阴影遮挡和光谱混淆的复杂场景中出现地表覆盖误分类。本文提出一种深度提示二维遥感语义分割框架(DepthSeg),能从二维遥感图像中自动建模深度/高度信息,并将其融入分割框架,缓解光谱混淆与阴影遮挡的影响。在特征提取阶段,引入轻量级适配器,实现基于自然图像预训练的大参数视觉变换器编码器的低成本微调;在深度提示阶段,提出深度提示器,显式建模高程特征;在语义预测阶段,设计语义分类解码器,将深度提示与高层地物特征耦合,实现精准的土地覆盖类型提取。在柳州数据集上的实验验证了该框架在土地覆盖制图任务中的优势,消融实验进一步证明了深度提示在遥感语义分割中的关键作用。

原文摘要 · Abstract (English)

Remote sensing semantic segmentation is crucial for extracting detailed land surface information, enabling applications such as environmental monitoring, land use planning, and resource assessment. In recent years, advancements in artificial intelligence have spurred the development of automatic remote sensing semantic segmentation methods. However, the existing semantic segmentation methods focus on distinguishing spectral characteristics of different objects while ignoring the differences in the elevation of the different targets. This results in land cover misclassification in complex scenarios involving shadow occlusion and spectral confusion. In this paper, we introduce a depth prompting two-dimensional (2D) remote sensing semantic segmentation framework (DepthSeg). It automatically models depth/height information from 2D remote sensing images and integrates it into the semantic segmentation framework to mitigate the effects of spectral confusion and shadow occlusion. During the feature extraction phase of DepthSeg, we introduce a lightweight adapter to enable cost-effective fine-tuning of the large-parameter vision transformer encoder pre-trained by natural images. In the depth prompting phase, we propose a depth prompter to model depth/height features explicitly. In the semantic prediction phase, we introduce a semantic classification decoder that couples the depth prompts with high-dimensional land-cover features, enabling accurate extraction of land-cover types. Experiments on the LiuZhou dataset validate the advantages of the DepthSeg framework in land cover mapping tasks. Detailed ablation studies further highlight the significance of the depth prompts in remote sensing semantic segmentation.

遥感分割深度提示地表覆盖视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。