DrivIng构建了带高保真数字孪生的大型多模态驾驶数据集,支持真实场景与仿真间无缝切换。
DrivIng: A Large-Scale Multimodal Driving Dataset with Full Digital Twin Integration
- 构建18公里路线的全要素数字孪生,集成6摄像头+1激光雷达+高精度定位
- 覆盖昼夜不同光照条件,共12类目标,标注120万实例,频率10Hz
- 支持真实交通流到仿真的1对1迁移,适合自动驾驶感知算法验证
感知是自动驾驶的核心,使车辆能理解环境并做出安全决策。开发鲁棒感知算法需要大规模、高质量的数据集,涵盖多样驾驶场景并支持全面评估。现有数据集普遍缺乏高保真数字孪生,限制了系统性测试、边缘场景模拟、传感器修改及仿真到现实的评估。为填补这一空白,我们提出DrivIng,一个包含完整地理参考数字孪生的大规模多模态数据集,覆盖约18公里的城市、郊区和高速公路路段。数据集提供六路RGB摄像头、一路激光雷达及基于ADMA的高精度定位连续记录,涵盖白天、黄昏和夜间。所有序列以10Hz频率标注3D边界框和轨迹ID,涉及12类目标,共约120万标注实例。得益于数字孪生,DrivIng可实现真实交通流到仿真环境的1:1迁移,在保留交互关系的同时支持逼真灵活的场景测试。为支持可复现研究与鲁棒验证,我们使用前沿感知模型对DrivIng进行基准测试,并公开发布数据集、数字孪生、高清地图及代码库。
原文摘要 · Abstract (English)
Perception is a cornerstone of autonomous driving, enabling vehicles to understand their surroundings and make safe, reliable decisions. Developing robust perception algorithms requires large-scale, high-quality datasets that cover diverse driving conditions and support thorough evaluation. Existing datasets often lack a high-fidelity digital twin, limiting systematic testing, edge-case simulation, sensor modification, and sim-to-real evaluations. To address this gap, we present DrivIng, a large-scale multimodal dataset with a complete geo-referenced digital twin of a ~18 km route spanning urban, suburban, and highway segments. Our dataset provides continuous recordings from six RGB cameras, one LiDAR, and high-precision ADMA-based localization, captured across day, dusk, and night. All sequences are annotated at 10 Hz with 3D bounding boxes and track IDs across 12 classes, yielding ~1.2 million annotated instances. Alongside the benefits of a digital twin, DrivIng enables a 1-to-1 transfer of real traffic into simulation, preserving agent interactions while enabling realistic and flexible scenario testing. To support reproducible research and robust validation, we benchmark DrivIng with state-of-the-art perception models and publicly release the dataset, digital twin, HD map, and codebase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。