构建热带森林树冠分割数据集,提升复杂环境下的树木识别精度。
SelvaMask: Segmenting Trees in Tropical Forests and Beyond
- 设计模块化检测-分割流程,用领域专用提示词适配视觉基础模型
- 在超8800棵树冠上实现当前最佳分割效果,优于零样本与端到端方法
- 适用于热带及温带森林监测,推动生态遥感智能化
热带森林承载了全球大部分树木生物多样性,其树冠层在碳储存与生态系统功能中起关键作用。大规模研究需精准分割单个树冠,通常依赖高分辨率航空影像。尽管基于Transformer的模型有所进展,但在多数森林尤其是热带地区表现仍不理想。为此,我们提出SelvaMask,一个包含巴拿马、巴西和厄瓜多尔三个新热带森林站点超过8,800个手动标注树冠的全新数据集。该数据集具备全面注释,包括标注者间一致性评估,真实反映热带森林的密集结构,凸显任务难度。基于此基准,我们提出一种模块化检测-分割流水线,通过领域特定的检测提示器适配视觉基础模型(VFMs),在密集热带森林中达到领先性能,优于零样本通用模型和全监督端到端方法。我们在外部热带与温带数据集上验证了其泛化能力,证明SelvaMask既是挑战性基准,也是推动泛化森林监测的关键工具。代码与数据集将公开发布。
原文摘要 · Abstract (English)
Tropical forests harbor most of the planet's tree biodiversity and are critical to global ecological balance. Canopy trees in particular play a disproportionate role in carbon storage and functioning of these ecosystems. Studying canopy trees at scale requires accurate delineation of individual tree crowns, typically performed using high-resolution aerial imagery. Despite advances in transformer-based models for individual tree crown segmentation, performance remains low in most forests, especially tropical ones. To this end, we introduce SelvaMask, a new tropical dataset containing over 8,800 manually delineated tree crowns across three Neotropical forest sites in Panama, Brazil, and Ecuador. SelvaMask features comprehensive annotations, including an inter-annotator agreement evaluation, capturing the dense structure of tropical forests and highlighting the difficulty of the task. Leveraging this benchmark, we propose a modular detection-segmentation pipeline that adapts vision foundation models (VFMs), using domain-specific detection-prompter. Our approach reaches state-of-the-art performance, outperforming both zero-shot generalist models and fully supervised end-to-end methods in dense tropical forests. We validate these gains on external tropical and temperate datasets, demonstrating that SelvaMask serves as both a challenging benchmark and a key enabler for generalized forest monitoring. Our code and dataset will be released publicly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。