arXiv:2502.00083cs.CVeess.IV2025-02被引 1

构建多模态遥感数据集,助力稀疏地类精准分类

CerraData-4MM: A multimodal benchmark dataset on Cerrado for land use and land cover classification

  • 融合哨兵1号雷达与2号多光谱影像,10米分辨率
  • 视觉变压器模型在多模态场景下达57.6%宏平均F1
  • 适合研究土地覆盖分类与不平衡学习的学者

塞拉多地区面临日益严峻的环境压力,亟需准确的土地利用与土地覆盖(LULC)制图,但存在类别不平衡和视觉相似类别等挑战。为此,我们提出CerraData-4MM,一个结合哨兵1号合成孔径雷达(SAR)和哨兵2号多光谱影像(MSI)、空间分辨率为10米的多模态数据集。数据集包含两个层级分类体系,分别有7类和14类,聚焦于生物多样性丰富的比科杜帕帕加伊奥生态区。通过评估标准U-Net与更先进的视觉变压器(ViT)模型,验证了该数据集在基准化先进语义分割技术方面的潜力。在第一层级分类中,ViT在多模态场景下取得最高宏平均F1-score 57.60%,平均交并比(mIoU)为49.05%。两种模型在第二层级对少数类表现均不佳,其中U-Net的F1-score降至18.16%。类别平衡虽提升少数类表征,但降低整体精度,凸显加权训练中的权衡。CerraData-4MM为推进深度学习模型应对类别不平衡与多模态数据融合提供了挑战性基准。代码、训练模型及数据可在https://github.com/ai4luc/CerraData-4MM公开获取。

原文摘要 · Abstract (English)

The Cerrado faces increasing environmental pressures, necessitating accurate land use and land cover (LULC) mapping despite challenges such as class imbalance and visually similar categories. To address this, we present CerraData-4MM, a multimodal dataset combining Sentinel-1 Synthetic Aperture Radar (SAR) and Sentinel-2 MultiSpectral Imagery (MSI) with 10m spatial resolution. The dataset includes two hierarchical classification levels with 7 and 14 classes, respectively, focusing on the diverse Bico do Papagaio ecoregion. We highlight CerraData-4MM's capacity to benchmark advanced semantic segmentation techniques by evaluating a standard U-Net and a more sophisticated Vision Transformer (ViT) model. The ViT achieves superior performance in multimodal scenarios, with the highest macro F1-score of 57.60% and a mean Intersection over Union (mIoU) of 49.05% at the first hierarchical level. Both models struggle with minority classes, particularly at the second hierarchical level, where U-Net's performance drops to an F1-score of 18.16%. Class balancing improves representation for underrepresented classes but reduces overall accuracy, underscoring the trade-off in weighted training. CerraData-4MM offers a challenging benchmark for advancing deep learning models to handle class imbalance and multimodal data fusion. Code, trained models, and data are publicly available at https://github.com/ai4luc/CerraData-4MM.

土地覆盖多模态遥感不平衡学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。