构建全球首个街道树木细粒度分类数据集,助力城市生态研究
StreetTree: A Large-Scale Global Benchmark for Fine-Grained Tree Species Classification
- 收集133国8300余种街道树图像,覆盖五大洲
- 超1200万张图片,包含季节变化与复杂光照等挑战
- 支持细粒度分类与城市科学交叉研究,适合计算机视觉与生态学者
街道树木的细粒度分类对城市规划、景观管理和城市生态系统服务评估至关重要。然而,该领域进展受限于缺乏大规模、地理多样且公开可用的基准数据集。为此,我们推出全球首个专为街道树木细粒度分类设计的大规模基准数据集StreetTree。该数据集包含超过1200万张图像,覆盖8300余种常见街道树物种,数据源自全球133个国家、五大洲的城市街景,并补充了专家验证的观测数据。StreetTree在复杂城市环境中对预训练视觉模型提出挑战:物种间视觉相似度高、自然分布长尾化、同一物种因季节变化导致类内差异大,以及光照、建筑遮挡和相机角度多样等成像条件复杂。此外,我们提供基于科、属、种的层级分类体系,支持层次分类与表征学习研究。通过多种视觉模型的广泛实验,我们建立了可靠基线,并揭示现有方法在处理真实世界复杂性方面的局限性。我们认为,StreetTree将成为推动计算机视觉与城市科学交叉创新的关键资源。
原文摘要 · Abstract (English)
The fine grained classification of street trees is a crucial task for urban planning, streetscape management, and the assessment of urban ecosystem services. However, progress in this field has been hindered by the lack of large scale, geographically diverse, and publicly available benchmark datasets specifically designed for street trees. To address this critical gap, we introduce StreetTree, the world's first large scale benchmark dataset dedicated to fine grained street tree classification. The dataset contains over 12 million images covering more than 8,300 common street tree species, collected from urban streetscapes across 133 countries spanning five continents, and supplemented with expert verified observational data. StreetTree poses challenges for pretrained vision models under complex urban environments including high inter species visual similarity, long tailed natural distributions, significant intra class variations caused by seasonal changes, and diverse imaging conditions such as lighting, occlusions from buildings, and varying camera angles. In addition, we provide a hierarchical taxonomy (order, family, genus, and species) to support research in hierarchical classification and representation learning. Through extensive experiments with various vision models, we establish solid baselines and reveal the limitations of existing methods in handling such real world complexities. We believe that StreetTree will serve as a key resource for driving new advancements at the intersection of computer vision and urban science.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。