首个开放的4D FMCW激光雷达数据集,支持动态场景感知与自动驾驶决策研究。
4DLidarOpen: An Open 4D FMCW Lidar Dataset for Motion-Aware Autonomous Driving

- 融合4D FMCW激光雷达速度信息与多传感器数据,实现运动感知
- 相比仅几何信息的激光雷达,速度感知提升对行人和快车的识别精度
- 适合研究多激光雷达融合、运动预测与自动驾驶规划的学者使用
我们提出4DLidarOpen,一个大规模开源的多模态自动驾驶数据集,核心为4D调频连续波(FMCW)激光雷达感知。不同于传统飞行时间激光雷达仅提供几何测量,4DLidarOpen包含前向4D FMCW激光雷达的逐点径向速度信息,并集成多种类型激光雷达(旋转式、固态式、盲区式)、环视摄像头及6自由度自车位姿。数据采集于北京复杂城市环境,涵盖密集行人交互、拥堵交通、高速行驶及无保护变道等场景。数据集提供同步多传感器数据与3D边界框标注,跨五类物体保持持续轨迹ID。采用混合标注策略:大规模自动标注用于可扩展训练,人工专家精修用于训练与验证集。基于该数据集,建立3D目标检测、鸟瞰图分割、运动流预测及带规划的运动预测基准。大量实验表明,4D FMCW激光雷达直接提供的速度测量可为动态场景理解提供互补运动线索。相比仅几何感知,速度感知表示显著提升运动相关感知与下游预测规划性能,尤其在弱势道路使用者和快速移动物体场景中表现更优。结果表明,4D FMCW激光雷达是面向运动感知自动驾驶的有前景传感模态。数据集与评测工具包已公开发布,以支持4D场景理解、多激光雷达融合及速度感知与规划的研究。
原文摘要 · Abstract (English)
We present 4DLidarOpen, a large-scale open multi-modal dataset for autonomous driving, centered on 4D frequency-modulated continuous-wave (FMCW) Lidar sensing. Unlike conventional time-of-flight Lidar datasets that mainly provide geometric measurements, 4DLidarOpen includes point-wise radial velocity measurements from a forward-facing 4D FMCW Lidar, together with multiple Lidars of different types, including rotating, solid-state, and blind-spot variants, surround-view cameras, and 6-DOF ego-vehicle poses. The dataset was collected in complex urban environments in Beijing and covers dense pedestrian interactions, congested traffic, high-speed driving, and unprotected maneuvers. 4DLidarOpen provides synchronized multi-sensor data and 3D bounding-box annotations with persistent track IDs across five object categories. A hybrid annotation strategy is adopted, where large-scale auto-labeled data support scalable training and human experts refine annotations for the human-annotated training and validation sets. Based on this dataset, we establish benchmarks for 3D object detection, birds-eye view (BEV) segmentation and flow prediction, and motion forecasting with planning. Extensive experiments show that direct velocity measurements from 4D FMCW Lidar provide complementary motion cues for dynamic-scene understanding. Compared with geometric-only sensing, the velocity-aware representation improves motion-related perception and downstream forecasting and planning, especially in scenarios involving vulnerable road users and fast-moving objects. These results indicate that 4D FMCW Lidar is a promising sensing modality for motion-aware autonomous driving. The dataset and evaluation toolkit are publicly released to support research on 4D scene understanding, multi-Lidar fusion, and velocity-aware perception and planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。