基于CARLA的自动化框架,按用户条件生成多传感器高维时序数据。
Car-STAGE: Automated framework for large-scale high-dimensional simulated time-series data generation based on user-defined criteria
- 通过图形界面配置参数,全自动运行多传感器同步采集。
- 支持10+类传感器,单次生成可覆盖数百个对象与复杂光照环境。
- 适合自动驾驶研发团队快速构建大规模仿真数据集。
通过逼真仿真生成大规模感知数据是机器人应用(如自动驾驶)的关键环节。本文提出一种名为Car-STAGE的新框架,基于开源CARLA模拟器,实现基于用户定义条件的多传感器同步数据采集。该框架通过图形化界面设置地图、传感器数量与配置、环境及光照等参数,自动在后台运行仿真,从RGB相机、LiDAR、Radar、深度相机、IMU、GNSS、语义分割相机、实例分割相机和光流相机等多种传感器获取高维数据,并存储带真实标注的传感器数据与目标状态至本地或云端数据库。系统采用多线程架构:主进程管理服务,工作线程处理队列与帧号,其余线程并行处理传感器数据。通过将原始二进制数据内存映射到磁盘并在采集结束后统一转换格式,显著提升效率。实验表明,在增加传感器数量与生成对象数的条件下,相比原生实现,该框架在帧率上获得显著加速。
原文摘要 · Abstract (English)
Generating large-scale sensing datasets through photo-realistic simulation is an important aspect of many robotics applications such as autonomous driving. In this paper, we consider the problem of synchronous data collection from the open-source CARLA simulator using multiple sensors attached to vehicle based on user-defined criteria. We propose a novel, one-step framework that we refer to as Car-STAGE, based on CARLA simulator, to generate data using a graphical user interface (GUI) defining configuration parameters to data collection without any user intervention. This framework can utilize the user-defined configuration parameters such as choice of maps, number and configurations of sensors, environmental and lighting conditions etc. to run the simulation in the background, collecting high-dimensional sensor data from diverse sensors such as RGB Camera, LiDAR, Radar, Depth Camera, IMU Sensor, GNSS Sensor, Semantic Segmentation Camera, Instance Segmentation Camera, and Optical Flow Camera along with the ground-truths of the individual actors and storing the sensor data as well as ground-truth labels in a local or cloud-based database. The framework uses multiple threads where a main thread runs the server, a worker thread deals with queue and frame number and the rest of the threads processes the sensor data. The other way we derive speed up over the native implementation is by memory mapping the raw binary data into the disk and then converting the data into known formats at the end of data collection. We show that using these techniques, we gain a significant speed up over frames, under an increasing set of sensors and over the number of spawned objects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。