用无人机近距离影像提升热带树种分类准确率
Understanding Representation Gaps Across Scales in Tropical Tree Species Classification from Drone Imagery

- 对比高空俯视与近距离无人机影像的分类表现
- 近距离影像分类准确率更高,稀有物种差距更大
- 自监督对齐跨尺度特征,适合生态监测研究者
从无人飞行器(UAV)影像中准确分类热带树种仍具挑战,因物种多样性高且在典型图像分辨率(厘米级像素)下视觉相似度强。相比之下,基于智能手机拍摄的公民科学照片训练的模型可实现优异的植物分类性能。如今,UAV数据采集技术进步使获取与航拍图像空间对齐的近距离影像成为可能,其视觉细节接近智能手机照片,但无法覆盖多数树木。本文评估了现有方法在一对高分辨率近距离与低分辨率俯视影像上的表现。通过微调实验,量化了视觉基础模型与领域内通用植物识别模型在两类图像上的性能差距。结果显示,近距离影像分类性能始终优于俯视影像,且稀有物种的差距更显著。最后提出,跨空间尺度的自监督表征对齐有望将细粒度视觉信息融入基于俯视影像的冠层级分类模型中。利用高分辨率近距离影像提升冠层级分类,可显著增强热带森林生物多样性大范围监测能力。
原文摘要 · Abstract (English)
Accurate classification of tropical tree species from unoccupied aerial vehicle (UAV) imagery remains challenging due to high species diversity and strong visual similarity among species at typical image resolutions (centimeters per pixel). In contrast, models trained on close-up citizen science photographs captured with smartphones achieve strong plant species classification performance. Recent advances in UAV data acquisition now enable the collection of close-up images that are spatially registered with top-view aerial imagery and approach the level of visual detail found in smartphone photographs, with the trade-off that such high-resolution photos cannot be acquired for many trees. In this work, we evaluate the performance of existing methods using paired top-view and close-up UAV imagery collected in a species-rich tropical forest. Through fine-tuning experiments, we quantify the performance gap between vision foundation models and in-domain generalist plant recognition models across both image types (high-resolution close-up versus coarser-resolution top-view imagery). We show that classification performance is consistently higher on close-up images than on top-view aerial imagery, and that this performance gap widens for rare species. Finally, we propose that self-supervised representation alignment across these two spatial scales offers a promising approach for integrating fine-grained visual information into canopy-level species classification models based on top-view UAV imagery. Leveraging high-resolution close-up UAV imagery to enhance canopy-level species classification could substantially improve large-scale monitoring of tropical forest biodiversity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。