梳理遥感图像语义分割的深度学习演进路径,从像素到图像级建模。
From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation
- 按分割粒度将方法分为像素、区块、瓦片和图像四层结构
- 涵盖主流方法与数据集,对比性能并指出模型效率等挑战
- 适合关注遥感视觉分析的科研人员与工程师参考
遥感图像语义分割(RSISS)实现地表特征的细粒度解析,是遥感分析的关键任务。随着多平台传感器采集的遥感图像数量和多样性持续增长,传统处理方法在效率和精度上逐渐力不从心。深度学习通过自动提取层次化特征,在跨模态场景下显著提升了分割性能,推动了RSISS的结构性演进:从早期的像素级分类,发展到区块与瓦片级建模,再到当前基于视觉基础模型的图像级端到端分割。然而,现有综述多聚焦于单一组件(如监督策略或特征融合),缺乏与分割粒度和训练推理流程对齐的统一视角。本文首次构建‘像素-区块-瓦片-图像’层级框架,系统梳理各类方法,总结代表性数据集,分析比较结果,并指出数据规模、模型效率、域鲁棒性及多模态融合等方面的开放问题。为促进可复现研究,作者提供代码库链接:https://github.com/quanweiliu/PatchwiseClsFra 和 https://github.com/quanweiliu/TilewiseSegFra。
原文摘要 · Abstract (English)
Semantic segmentation (SS) of RSIs enables the fine-grained interpretation of surface features, making it a critical task in RS analysis. With the increasing diversity and volume of RSIs collected by sensors on various platforms, traditional processing methods struggle to maintain efficiency and accuracy. In response, deep learning (DL) has emerged as a transformative approach, enabling substantial advances in remote sensing image semantic segmentation (RSISS) by automating hierarchical feature extraction and improving segmentation performance across diverse modalities. As data scale and model capacity have increased, DL-based RSISS has undergone a structural evolution from pixel-level and patch-based classification to tile-level, end-to-end segmentation, and, more recently, to image-level modelling with vision foundation models. However, existing reviews often focus on individual components, such as supervision strategies or fusion stages, and lack a unified operational perspective aligned with segmentation granularity and the training/inference pipeline. This paper provides a comprehensive review by organizing DL-based RSISS into a pixel-patch-tile-image hierarchy, covering early pixel-based methods, prevailing patch-based and tile-based techniques, and emerging image-based approaches. This review offers a holistic and structured understanding of DL-based RSISS, highlighting representative datasets, comparative insights, and open challenges related to data scale, model efficiency, domain robustness, and multimodal integration. Furthermore, to facilitate reproducible research, curated code collections are provided at: https://github.com/quanweiliu/PatchwiseClsFra and https://github.com/quanweiliu/TilewiseSegFra.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。