arXiv:2511.08156cs.CV2025-11中稿 · ISPRS for publicat…

用弱监督训练通用土地利用模型,零样本迁移表现优异。

LandSegmenter: Towards a Flexible Foundation Model for Land Use and Land Cover Mapping

  • 构建多源弱标签数据集LAS,降低标注成本
  • 融合跨模态适配器与文本编码器,提升语义理解
  • 类置信度融合策略改善漏分问题,适合零样本应用

土地利用与土地覆盖(LULC)映射是地球观测的核心任务。现有模型通常针对特定模态和固定分类体系,泛化能力受限。尽管基础模型有潜力构建通用模型,但任务无关模型需微调,而任务专用模型又依赖大量标注数据,成本高昂。为此,我们提出LandSegmenter框架,从输入、模型、输出三阶段解决挑战:输入端构建LAS数据集,基于全球采样弱标签,实现低成本大规模训练;模型端引入遥感适配器与文本编码器,增强跨模态特征提取与语义感知;输出端采用类置信度引导融合策略,缓解语义遗漏。在六个高精度标注的LULC数据集上评估,涵盖不同模态与分类体系。大量迁移学习与零样本实验表明,LandSegmenter在未见数据集上表现优异,验证了弱监督构建任务专用基础模型的有效性。

原文摘要 · Abstract (English)

Land Use and Land Cover (LULC) mapping is a fundamental task in Earth Observation (EO). However, current LULC models are typically developed for a specific modality and a fixed class taxonomy, limiting their generability and broader applicability. Recent advances in foundation models (FMs) offer promising opportunities for building universal models. Yet, task-agnostic FMs often require fine-tuning for downstream applications, whereas task-specific FMs rely on massive amounts of labeled data for training, which is costly and impractical in the remote sensing (RS) domain. To address these challenges, we propose LandSegmenter, an LULC FM framework that resolves three-stage challenges at the input, model, and output levels. From the input side, to alleviate the heavy demand on labeled data for FM training, we introduce LAnd Segment (LAS), a large-scale, multi-modal, multi-source dataset built primarily with globally sampled weak labels from existing LULC products. LAS provides a scalable, cost-effective alternative to manual annotation, enabling large-scale FM training across diverse LULC domains. For model architecture, LandSegmenter integrates an RS-specific adapter for cross-modal feature extraction and a text encoder for semantic awareness enhancement. At the output stage, we introduce a class-wise confidence-guided fusion strategy to mitigate semantic omissions and further improve LandSegmenter's zero-shot performance. We evaluate LandSegmenter on six precisely annotated LULC datasets spanning diverse modalities and class taxonomies. Extensive transfer learning and zero-shot experiments demonstrate that LandSegmenter achieves competitive or superior performance, particularly in zero-shot settings when transferred to unseen datasets. These results highlight the efficacy of our proposed framework and the utility of weak supervision for building task-specific FMs.

土地利用基础模型弱监督遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。