构建自然林下树种检测与分类数据集,解决森林自动化中的视觉挑战。
SilvaScenes: Tree Detection and Species Classification from Under-Canopy Images in Natural Forests
- 基于魁北克五类气候区采集的林下图像,实现树干精准分割与物种标注。
- 树干分割准确率最高达69.9% mAP,但物种识别仅39.2% mAP,仍存难点。
- 适合林业自动化、计算机视觉研究者,尤其关注遮挡与物种不均衡问题。
随着深度学习快速发展,林业自动化需求日益增长。树体检测与分类是野外调查和智能设备自动化的关键任务,但林下环境常面临严重遮挡、光照不均与植被密集等挑战。现有研究多集中于城市场景或少数物种,缺乏对自然森林中多物种并行检测与分类可行性的验证。为此,我们提出SilvaScenes数据集,涵盖加拿大魁北克五个生物气候区的林下图像,包含1421棵树、28个物种,提供像素级树干分割掩码及专家标注的细粒度物种信息。实验表明,尽管树干分割可达69.9% mAP与76.4% mAR,物种感知分割仍具挑战,仅达39.2% mAP与68.6% mAR。分析揭示物种不平衡与遮挡是主要瓶颈;高分辨率图像显著提升性能,未来可能成为关键技术。数据集、代码与模型将公开于https://github.com/norlab-ulaval/SilvaScenes。
原文摘要 · Abstract (English)
Interest in forestry automation is growing alongside rapid advances in deep learning. In particular, tree detection and taxonomic classification are seen as core tasks required for automating field surveys and forestry equipment. These operations must often be performed in under-canopy settings, which pose challenging conditions for perception systems, including heavy occlusion, variable lighting, and dense vegetation. Despite this necessity, current work has yet to properly establish the feasibility of simultaneously executing tree detection and taxonomic classification in natural forests, as available datasets primarily focus on urban settings or on a limited number of species. To address this gap, we present SilvaScenes, a benchmark dataset for instance segmentation of tree species from under-canopy images in natural forests. Collected across five bioclimatic domains in Quebec, Canada, our dataset features 1421 trees from 28 species, with segmentation masks for pixel-precise tree trunk detection and fine-grained species annotations from forestry experts. We demonstrate the relevance and difficult nature of SilvaScenes by evaluating modern deep learning approaches, showing that while trunk segmentation is feasible, with a top mean average precision (mAP) of 69.9% and mean average recall (mAR) of 76.4%, species-aware segmentation remains a significant challenge with an mAP and an mAR of only 39.2% and 68.6%, respectively. Alongside additional experiments, we highlight key challenges, namely that species imbalance and tree occlusion figure among the most pressing issues for precise segmentation and identification. Meanwhile, higher image resolutions contribute to significant performance gains and will likely prove fundamental to these tasks moving forward. Our dataset, source code, and models will be made available at https://github.com/norlab-ulaval/SilvaScenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。