首个融合激光雷达、雷达与相机的森林感知数据集,支持多模态检测与分割研究。
Viking Hill Dataset: A Lidar-Radar-Camera Dataset for Detection and Segmentation in Forest Scenes

- 采集带雷达、激光雷达和相机的移动机器人多模态数据,覆盖不同季节森林场景。
- 雷达在地面和树冠分割上达到91%和86%的交并比,优于激光雷达对树干的识别效果。
- 适合研究林区自动驾驶、传感器融合及多模态感知的科研人员使用。
在林冠下运行的自主机器人需要在不同季节条件下稳健感知树木与植被。现有林业数据集仅提供激光雷达或相机数据并带有逐树标注,但缺乏同步的4D成像雷达——这一日益受关注的模态因其对视觉退化、表面污染和植被遮挡的鲁棒性而备受青睐。本文引入一个由移动机器人搭载高分辨率FMCW成像雷达、激光雷达、RGB相机、IMU和RTK-GNSS采集的多传感器森林数据集。数据在两种植被状态下的两个时段录制,提供3D立方体标注(含每棵树直径估计),实现三种感知模态间的共享语义标签。此外,我们基于MinkowskiUNet提供了雷达与激光雷达点云的语义分割基线结果:雷达在主要类别上表现优异(地面IoU 91%,树冠IoU 86%),但在几何细节如树干上仍落后于激光雷达(56% vs. 74%)。跨模态分析对比了激光雷达与雷达在树干分割上的表现,并通过按直径分层评估揭示了树干分割质量随树体大小的变化规律。除分割外,同步多模态数据与RTK-GNSS辅助定位支持林区地图构建、定位与传感器融合研究。数据集与标注工具已公开。
原文摘要 · Abstract (English)
Autonomous robots operating under forest canopies need robust perception of trees and surrounding vegetation across varying seasonal conditions. Existing forestry datasets provide lidar or camera data with per-tree annotations, but none include co-registered 4D imaging radar -- a modality of growing interest for its resilience to visual degradation, surface contamination, and vegetation occlusion. We introduce a multi-sensor forest dataset collected by a mobile robot equipped with a high-resolution FMCW imaging radar, lidar, RGB camera, IMU, and RTK-GNSS. The site was recorded in two sessions under contrasting vegetation states, and 3D cuboid annotations -- including per-tree diameter estimates -- provide shared semantic labels across all three perception modalities. Furthermore, we provide baseline results for semantic segmentation of the radar and lidar point clouds using MinkowskiUNet. Radar achieves IoU scores competitive with lidar for dominant classes (ground 91%, canopy 86%) while lagging on geometrically fine structures such as tree trunks (56% vs. 74%). A cross-modality analysis further compares lidar and radar trunk segmentation against an RGB detection model, and a diameter-stratified evaluation reveals how trunk segmentation quality varies with tree size. Beyond segmentation, the co-registered multi-modal data and RTK-GNSS-aided reference positioning support research in mapping, localization, and sensor fusion under canopy. The dataset and annotation tools are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。