arXiv:2508.12409cs.CV2025-08AAAI被引 7

用海量未标注遥感数据训练出更强的分割模型,突破小数据限制。

S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensing

  • 基于熵筛选与多样性扩展选择数据,构建百万级遥感数据集RS4P-1M
  • 提出S4预训练新范式,使模型在土地覆盖分割等任务上性能显著提升
  • 采用专家混合架构,高效适配多个遥感数据集,提升模型泛化能力

半监督语义分割(S4)通过伪标签和一致性学习利用未标注数据,在遥感分析中取得进展。然而现有研究多依赖小规模数据集与模型,实用性受限。为此,我们提出S5——首个可扩展的遥感半监督语义分割框架,释放大量未标注地球观测数据的潜力。基于现有大规模遥感数据集,S5引入基于熵的过滤与多样性扩展的数据选择策略,构建了RS4P-1M数据集。基于此,系统性地将S4扩展为新预训练范式——S4预训练(S4P),在该大规模语料上预训练不同规模的遥感基础模型(RSFMs),显著提升其在土地覆盖分割与目标检测任务上的表现。此外,在微调阶段引入基于专家混合(MoE)的多数据集微调方法,以更少参数高效适配多个遥感基准,增强模型跨基准的泛化与通用性。所获RSFMs在所有基准上均达当前最佳性能,验证了半监督学习在遥感应用中规模化可行性。所有数据集、代码与模型将开源于https://github.com/MiliLab/S5。

原文摘要 · Abstract (English)

Semi-supervised semantic segmentation (S4) has advanced remote sensing (RS) analysis by leveraging unlabeled data through pseudo-labeling and consistency learning. However, existing S4 studies often rely on small-scale datasets and models, limiting their practical applicability. To address this, we propose S5, the first scalable framework for semi-supervised semantic segmentation in RS, which unlocks the potential of vast unlabeled Earth observation data typically underutilized due to costly pixel-level annotations. Built upon existing large-scale RS datasets, S5 introduces a data selection strategy that integrates entropy-based filtering and diversity expansion, resulting in the RS4P-1M dataset. Using this dataset, we systematically scale up S4 into a new pretraining paradigm, S4 pre-training (S4P), to pretrain RS foundation models (RSFMs) of varying sizes on this extensive corpus, significantly boosting their performance on land cover segmentation and object detection tasks. Furthermore, during fine-tuning, we incorporate a Mixture-of-Experts (MoE)-based multi-dataset fine-tuning approach, which enables efficient adaptation to multiple RS benchmarks with fewer parameters. This approach improves the generalization and versatility of RSFMs across diverse RS benchmarks. The resulting RSFMs achieve state-of-the-art performance across all benchmarks, underscoring the viability of scaling semi-supervised learning for RS applications. All datasets, code, and models will be released at https://github.com/MiliLab/S5

遥感半监督大模型分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。