提升DeepLabV3+融合航拍与卫星图像,实现更精准的语义分割。
Enhancing DeepLabV3+ to Fuse Aerial and Satellite Images for Semantic Segmentation
- 引入新型反卷积块,增强卫星图像信息融合能力
- 在LandCover.ai数据集上达84.91% mIoU,无需数据增强
- 适合遥感图像多源融合与土地覆盖分类研究者
航拍与卫星影像在分辨率和覆盖范围上具有天然互补性。然而,将二者用于地表覆盖语义分割面临诸多挑战。尽管DeepLabV3+在单源图像分割中表现良好,但在多模态融合任务中仍需提升鲁棒性与性能。本文通过引入新的转置卷积层模块,对卫星影像进行上采样,并与高阶特征融合,增强其信息表达能力。实验采用LandCover.ai(航拍图像)与对应Sentinel-2数据集,融合双源数据后,在未使用数据增强的情况下,实现了84.91%的平均交并比(mIoU)。
原文摘要 · Abstract (English)
Aerial and satellite imagery are inherently complementary remote sensing sources, offering high-resolution detail alongside expansive spatial coverage. However, the use of these sources for land cover segmentation introduces several challenges, prompting the development of a variety of segmentation methods. Among these approaches, the DeepLabV3+ architecture is considered as a promising approach in the field of single-source image segmentation. However, despite its reliable results for segmentation, there is still a need to increase its robustness and improve its performance. This is particularly crucial for multimodal image segmentation, where the fusion of diverse types of information is essential. An interesting approach involves enhancing this architectural framework through the integration of novel components and the modification of certain internal processes. In this paper, we enhance the DeepLabV3+ architecture by introducing a new transposed conventional layers block for upsampling a second entry to fuse it with high level features. This block is designed to amplify and integrate information from satellite images, thereby enriching the segmentation process through fusion with aerial images. For experiments, we used the LandCover.ai (Land Cover from Aerial Imagery) dataset for aerial images, alongside the corresponding dataset sourced from Sentinel 2 data. Through the fusion of both sources, the mean Intersection over Union (mIoU) achieved a total mIoU of 84.91% without data augmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。