arXiv:2411.11252cs.ROcs.CV2024-11CVPR被引 37

构建高保真4D驾驶世界,实现闭环动态测试

DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulation

  • 构建包含静态背景与动态物体的4D占用表征世界
  • 生成多视角高保真视频输出,保证时空一致性
  • 支持真实感闭环测试,适合自动驾驶算法验证

自动驾驶评估需要高度还原真实道路条件的仿真环境,包括真实感官数据和响应反馈回路。现有仿真多依赖公开数据集上固定路径的预设轨迹或合成逼真图像,即开环仿真难以评估动态决策能力。尽管近期闭环仿真已引入反馈机制,但无法处理视觉传感器输入,且输出与真实数据存在差异。为此,我们提出DrivingSphere,一个真实且闭环的仿真框架。其核心是构建4D世界表征,并生成真实可控的驾驶场景。具体包括:动态环境构建模块,以占用网格形式整合静态背景与动态物体,形成详细的4D驾驶世界;视觉场景生成模块,将该数据转换为多视角高保真视频输出,确保空间与时间一致性。DrivingSphere提供动态真实的仿真环境,支持自动驾驶算法的全面测试与验证,推动更可靠的自动驾驶系统发展。基准数据集将公开发布。

原文摘要 · Abstract (English)

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints along fixed routes on public datasets or synthetic photorealistic data, \ie, open-loop simulation usually lacks the ability to assess dynamic decision-making. While the recent efforts of closed-loop simulation offer feedback-driven environments, they cannot process visual sensor inputs or produce outputs that differ from real-world data. To address these challenges, we propose DrivingSphere, a realistic and closed-loop simulation framework. Its core idea is to build 4D world representation and generate real-life and controllable driving scenarios. In specific, our framework includes a Dynamic Environment Composition module that constructs a detailed 4D driving world with a format of occupancy equipping with static backgrounds and dynamic objects, and a Visual Scene Synthesis module that transforms this data into high-fidelity, multi-view video outputs, ensuring spatial and temporal consistency. By providing a dynamic and realistic simulation environment, DrivingSphere enables comprehensive testing and validation of autonomous driving algorithms, ultimately advancing the development of more reliable autonomous cars. The benchmark will be publicly released.

自动驾驶仿真环境4D建模闭环测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。