arXiv:2608.23040cs.RO2026-08

用地图自动生成高保真赛车环境,支持自然语言建模

RoboRacer Arena: Scaling High-Fidelity Autonomous Racing in Isaac Sim

  • 从栅格地图自动构建3D赛道,融合物理碰撞与程序化生成
  • 支持自然语言输入生成赛道,30次测试全部通过验证
  • 每秒可处理8707个车辆动作,适合大规模强化学习实验

RoboRacer Arena 解决了自主赛车仿真中赛道扩展难的问题。该系统能直接从占用栅格地图生成包含物理接触的3D赛道环境,利用洪水填充算法提取可行驶区域和边界,并通过距离场定义碰撞范围。所有材质、表面与物理属性整合至USD场景中,实现自动化、可复现的环境生成。输入可来自SLAM数据、公式一赛道缩放或自然语言描述;当使用自然语言时,采用Gemma 4 31B生成无坐标轨道规范。通过几何筛选、程序生成与像素级验证确保一致性。环境初始化时间在1.18至2.48秒之间,随栅格尺寸线性增长。在10条赛道、3种随机种子的30组匹配试验中,21张地图成功生成并通过验证。目前平台已含130条赛道,支持自然语言生成。基准测试显示,256个刚体车辆并行运行时,系统可达8,707辆次/秒(不含渲染与策略执行耗时)。

原文摘要 · Abstract (English)

RoboRacer offers a standardized platform for research using 1:10-scale autonomous vehicles, but the variety of available tracks hinders the process of acquiring policies. Although existing occupancy-grid simulators allow for the quick addition of new maps, they fail to include physical contact, while 3D simulators require each circuit to be implemented as a separate asset, thus limiting their scalability. In order to overcome this issue, we have developed RoboRacer Arena, a system that creates 3D racing environments directly from occupancy maps. Our method starts by using a flood fill algorithm to extract the drivable corridors and to identify the track boundaries, which are then used to establish the barriers. A distance field is calculated to define the collision boundaries. The track surfaces, collision properties, and materials are assembled into a USD stage, which allows for the automated and reproducible generation of the environment in Isaac Sim. The input maps can be obtained from SLAM sessions, from rescaled Formula 1 circuits, or from natural-language descriptions. When the input is based on natural language, we use Gemma 4 31B to generate a track specification without specifying any coordinates or geometry. To guarantee consistency and reproducibility, we apply geometric screening, procedural generation, and raster-level validation. The simulation environments are initialized in a time range of 1.18 to 2.48 seconds, with the initialization time increasing linearly as the raster size increases. In 30 matched trials involving 10 tracks and 3 seeds, 21 maps were generated and all passed validation. RoboRacer Arena currently contains 130 tracks and supports the generation of tracks from natural language. In benchmark tests, the system attains 8,707 vehicle-steps per second when using 256 parallel rigid-body vehicles, excluding the time taken for rendering and policy execution.

自动驾驶仿真环境自然语言生成强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。