arXiv:2606.14562cs.CVcs.LG2026-06

构建高分辨率鸟类巢穴3D数据集,助力生态研究与算法测试

NEST3D: A High-Resolution Multimodal Dataset of Sociable Weaver Tree Nests

论文配图:NEST3D: A High-Resolution Multimodal Dataset of Sociable Weaver Tree Nests
图 1 · 摘自论文原文
  • 用无人机采集104棵树的多模态数据,含百万级3D点云
  • 点云分割模型在测试集上达到86.35% mIoU,Transformer表现更优
  • 适合做3D生态重建、物种保护研究及应对类别不平衡的算法验证

社会性织巢鸟的巢穴是复杂的生态结构,提供温控微环境并支持多种生物;但以往研究使用的数据集缺乏精细的三维结构细节。由于巢穴几何不规则且与复杂宿主植被交织,生成可用且精确的3D巢穴数据极具挑战。本文构建了一个开放获取的1.4TB多模态无人机数据集,涵盖104棵带巢树木,包含27,945张RGB图像、111,780张多光谱图像、约7.81亿个3D点以及专家标注的语义分割标签。我们使用KPConv、RandLA-Net和Point Transformer V3进行语义分割基准测试,其中PT-v3在测试集上取得86.35%的mIoU。结果表明,基于变换器和点式方法性能优异,但卷积类方法(如KPConv)仍面临架构依赖性挑战。该数据集通过融合光谱、空间与结构信息,推动了3D重建、分割与分类算法的发展,可支持巢穴体积估算到物种保护等生态应用,并作为高难度基准,暴露了极端类别不平衡下的架构性能差异。

原文摘要 · Abstract (English)

Sociable weaver nests function as complex ecological structures offering thermoregulatory microhabitats and sustaining diverse species; however, datasets used in prior studies lack fine-grained 3D structural detail. Producing usable and accurate 3D weaver nest data is challenging due to their irregular geometry and integration with complex host vegetation. We bridge this gap with an open-access, 1.4 TB multimodal drone dataset of 104 nest-bearing trees, comprising 27,945 RGB images, 111,780 multispectral images, approximately 781 million 3D points, and expert-annotated semantic segmentation labels. We benchmark semantic segmentation using KPConv, RandLA-Net, and Point Transformer V3, with PT-v3 achieving an mIoU of 86.35% on the test set. While the results demonstrate strong performance for transformer-based and point-wise methods, they also highlight architecture-dependent challenges, particularly for convolution-based approaches such as KPConv. By uniquely combining spectral, spatial, and structural information, the presented dataset advances 3D reconstruction, segmentation, and classification algorithms, enabling ecological applications from nest volume estimation to species conservation, and serves as a demanding benchmark that exposes architecture-dependent performance under extreme class imbalance.

3D重建多模态数据生态算法点云分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。