arXiv:2506.03114cs.CV2025-06被引 9

用预训练模型零样本分割航拍林区单棵树,无需标注数据

Zero-Shot Tree Detection and Segmentation from Aerial Forest Imagery

  • 直接使用SAM2模型零样本分割树木,不依赖标注数据
  • 结合已有检测模型的预测结果作为提示,提升分割精度
  • 适合缺乏标注数据的森林监测场景,可快速部署

从遥感影像中大规模识别单棵树对生态研究至关重要,尤其在气候变化加速森林演变的背景下。现有基于RGB图像的树分割方法需依赖标注数据训练专用模型,虽精度高但难以规模化。本文探索将先进的图像分割模型SAM2以零样本方式用于个体树木检测与分割。我们在两个任务上评估了预训练SAM2模型:(1) 零样本分割;(2) 通过现有树检测模型的预测结果作为提示进行零样本迁移。结果表明,SAM2不仅具备出色的泛化能力,还能与领域内有标注数据训练的专用方法自然协同。研究表明,将大模型应用于遥感问题是一条极具前景的发展路径。代码已开源:https://github.com/open-forest-observatory/tree-detection-framework。

原文摘要 · Abstract (English)

Large-scale delineation of individual trees from remote sensing imagery is crucial to the advancement of ecological research, particularly as climate change and other environmental factors rapidly transform forest landscapes across the world. Current RGB tree segmentation methods rely on training specialized machine learning models with labeled tree datasets. While these learning-based approaches can outperform manual data collection when accurate, the existing models still depend on training data that's hard to scale. In this paper, we investigate the efficacy of using a state-of-the-art image segmentation model, Segment Anything Model 2 (SAM2), in a zero-shot manner for individual tree detection and segmentation. We evaluate a pretrained SAM2 model on two tasks in this domain: (1) zero-shot segmentation and (2) zero-shot transfer by using predictions from an existing tree detection model as prompts. Our results suggest that SAM2 not only has impressive generalization capabilities, but also can form a natural synergy with specialized methods trained on in-domain labeled data. We find that applying large pretrained models to problems in remote sensing is a promising avenue for future progress. We make our code available at: https://github.com/open-forest-observatory/tree-detection-framework.

遥感分割零样本学习树木检测SAM2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。