arXiv:2601.11400cs.CVcs.AI2026-01被引 3

用稀疏标注和时序卫星图像实现高精度湿地自动制图

Wetland mapping from sparse annotations with satellite image time series and temporal-aware segment anything model

  • 双分支结构融合时间与空间信息,提升模型对湿地动态的感知能力
  • 在8个全球区域平均F1达85.58%,仅需少量标注即获精准分割
  • 适合需要低成本高分辨率湿地监测的生态研究与环境管理

精确的湿地制图对生态系统监测至关重要,但密集像素标注成本过高,实际应用多依赖稀疏点标签,现有深度学习模型表现不佳;同时湿地具有显著的季节与年际变化,单时相影像难以捕捉真实状态。尽管SAM等基础模型在点提示下展现良好泛化性,但其设计基于静态图像,无法建模时间信息,导致在异质湿地中生成碎片化掩码。为此,我们提出WetSAM:一种基于SAM的框架,通过双分支结构融合卫星时序图像,在稀疏点监督下实现湿地制图。其中时序分支引入分层适配器与动态时间聚合,分离湿地特征与物候变化;空间分支采用时序约束的区域生长策略生成可靠伪标签,双向一致性正则化联合优化两分支。在八个约5000 km²的全球区域上实验表明,WetSAM显著优于现有方法,平均F1分数达85.58%,以极低标注成本实现精准且结构一致的湿地分割,展现强大泛化能力,具备大规模、低成本、高分辨率湿地制图潜力。

原文摘要 · Abstract (English)

Accurate wetland mapping is essential for ecosystem monitoring, yet dense pixel-level annotation is prohibitively expensive and practical applications usually rely on sparse point labels, under which existing deep learning models perform poorly, while strong seasonal and inter-annual wetland dynamics further render single-date imagery inadequate and lead to significant mapping errors; although foundation models such as SAM show promising generalization from point prompts, they are inherently designed for static images and fail to model temporal information, resulting in fragmented masks in heterogeneous wetlands. To overcome these limitations, we propose WetSAM, a SAM-based framework that integrates satellite image time series for wetland mapping from sparse point supervision through a dual-branch design, where a temporally prompted branch extends SAM with hierarchical adapters and dynamic temporal aggregation to disentangle wetland characteristics from phenological variability, and a spatial branch employs a temporally constrained region-growing strategy to generate reliable dense pseudo-labels, while a bidirectional consistency regularization jointly optimizes both branches. Extensive experiments across eight global regions of approximately 5,000 km2 each demonstrate that WetSAM substantially outperforms state-of-the-art methods, achieving an average F1-score of 85.58%, and delivering accurate and structurally consistent wetland segmentation with minimal labeling effort, highlighting its strong generalization capability and potential for scalable, low-cost, high-resolution wetland mapping.

湿地制图时序图像弱监督分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。