arXiv:2509.13172cs.CV2025-09被引 5

构建跨城市多模态街树数据集,助力智慧城市建设

WHU-STree: A Multi-modal Benchmark Dataset for Street Tree Inventory

  • 融合点云与图像的多模态数据采集,支持复杂城市环境下的街树识别
  • 包含21007棵树、50个树种,标注了形态参数和物种信息
  • 适用于树种分类、个体分割等10余项任务,推动智能城市绿化管理

街道树木对城市宜居性至关重要,提供生态与社会双重效益。在空间受限的城市环境中,建立详尽、准确且动态更新的街树资产清单已成为优化这些多功能资源的关键。传统实地调查耗时耗力,利用移动测绘系统(MMS)实现自动化调查更具效率。然而,现有基于MMS的街树数据集存在场景规模小、标注有限或单一模态等问题,制约了全面分析。为此,本文提出WHU-STree,一个跨城市、丰富标注、多模态的都市街树数据集。数据采集于两座不同城市,整合同步点云与高分辨率图像,涵盖21,007个标注树实例,覆盖50个物种及2个形态参数。依托其独特特性,该数据集可同时支持超过10项街树资产管理任务。我们针对树种分类与单棵树分割两项核心任务进行了基准测试。大量实验与深入分析表明,多模态数据融合具有显著潜力,并强调跨域适用性是实际算法部署的关键前提。特别地,我们识别出关键挑战并展望未来研究方向,包括多模态融合、多任务协同、跨域泛化、空间模式学习以及面向街树资产管理的多模态大语言模型。数据集已开源:https://github.com/WHU-USI3DV/WHU-STree。

原文摘要 · Abstract (English)

Street trees are vital to urban livability, providing ecological and social benefits. Establishing a detailed, accurate, and dynamically updated street tree inventory has become essential for optimizing these multifunctional assets within space-constrained urban environments. Given that traditional field surveys are time-consuming and labor-intensive, automated surveys utilizing Mobile Mapping Systems (MMS) offer a more efficient solution. However, existing MMS-acquired tree datasets are limited by small-scale scene, limited annotation, or single modality, restricting their utility for comprehensive analysis. To address these limitations, we introduce WHU-STree, a cross-city, richly annotated, and multi-modal urban street tree dataset. Collected across two distinct cities, WHU-STree integrates synchronized point clouds and high-resolution images, encompassing 21,007 annotated tree instances across 50 species and 2 morphological parameters. Leveraging the unique characteristics, WHU-STree concurrently supports over 10 tasks related to street tree inventory. We benchmark representative baselines for two key tasks--tree species classification and individual tree segmentation. Extensive experiments and in-depth analysis demonstrate the significant potential of multi-modal data fusion and underscore cross-domain applicability as a critical prerequisite for practical algorithm deployment. In particular, we identify key challenges and outline potential future works for fully exploiting WHU-STree, encompassing multi-modal fusion, multi-task collaboration, cross-domain generalization, spatial pattern learning, and Multi-modal Large Language Model for street tree asset management. The WHU-STree dataset is accessible at: https://github.com/WHU-USI3DV/WHU-STree.

街树识别多模态数据城市绿化点云图像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。