arXiv:2501.14001cs.CVcs.AI2025-01被引 7

用众包标注与混合视觉模型,提升遥感图像中海带林的检测精度。

Enhancing kelp forest detection in remote sensing images using crowdsourced labels with Mixed Vision Transformers and ConvNeXt segmentation models

  • 融合众包标签与MIT+ConvNeXt模型,构建高效检测流水线。
  • 在Landsat影像上实现约75%像素级检测率,误报率低。
  • 适合需要大规模海洋生态监测的研究者与环保机构。

海带林作为基础物种,对海洋生态系统至关重要,为众多生物提供食物与栖息地。本研究探索将众包标注与先进人工智能模型结合,利用Landsat影像开发快速精准的海带冠层检测流程。基于机器学习竞赛的成功经验,该方法在本地验证及公开、私有排行榜上均表现优异,排名第三。研究证明混合视觉变压器(MIT)与ConvNeXt模型的结合具有显著效果。在多种图像尺寸下训练模型显著提升了集成结果的准确性。U-Net成为最优分割架构,UpperNet也贡献于最终集成。关键波段如短波红外(SWIR1)和近红外(NIR)至关重要,高程数据用于后处理以消除陆地上的假阳性。该方法实现了高检测率,约3/4含海带冠层的像素被准确识别,同时保持低误报率。尽管Landsat卫星分辨率中等,但其丰富的历史覆盖使其适用于海带林研究。本工作还凸显了机器学习模型与众包数据结合在环境监测中的潜力。所有训练与推理代码均开源,详见https://github.com/IoannisNasios/Kelp_Forests。

原文摘要 · Abstract (English)

Kelp forests, as foundation species, are vital to marine ecosystems, providing essential food and habitat for numerous organisms. This study explores the integration of crowdsourced labels with advanced artificial intelligence models to develop a fast and accurate kelp canopy detection pipeline using Landsat images. Building on the success of a machine learning competition, where this approach ranked third and performed consistently well on both local validation and public and private leaderboards, the research highlights the effectiveness of combining Mixed Vision Transformers (MIT) with ConvNeXt models. Training these models on various image sizes significantly enhanced the accuracy of the ensemble results. U-Net emerged as the best segmentation architecture, with UpperNet also contributing to the final ensemble. Key Landsat bands, such as ShortWave InfraRed (SWIR1) and Near-InfraRed (NIR), were crucial while altitude data was used in postprocessing to eliminate false positives on land. The methodology achieved a high detection rate, accurately identifying about three out of four pixels containing kelp canopy while keeping false positives low. Despite the medium resolution of Landsat satellites, their extensive historical coverage makes them effective for studying kelp forests. This work also underscores the potential of combining machine learning models with crowdsourced data for effective and scalable environmental monitoring. All running code for training all models and inference can be found at https://github.com/IoannisNasios/Kelp_Forests.

遥感检测海带林众包标注分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。