揭示主流GPU模拟器在大规模并行下的不确定性,推动机器人学习可靠性提升
GPUSimBench: Towards Scalable and Reliable GPU-Accelerated Simulators in Embodied AI

- 构建基于斜面任务的物理基准,量化仿真与真实动态的分布一致性
- 发现相同条件下运行结果差异大,证明GPU批处理引入显著非确定性
- 识别四种随机性模式,警示无约束扩展会破坏实验可复现性
数据驱动的具身智能正转向通过大规模并行仿真进行训练,其中GPU加速模拟器构成基础数据设施。然而,随着计算吞吐量提升,平行效率、物理保真度与执行确定性之间的权衡尚未被充分研究,制约了机器人学习的可靠性。本文提出GPUSimBench,针对可扩展性、物理一致性与计算确定性展开评估。首先,通过受控斜面任务建立物理基准,量化仿真动态与真实世界的分布对齐程度;其次,测量不同环境数量下的吞吐量与内存开销,评估并行扩展能力;关键的是,超越常规性能指标,揭示并量化了由GPU批处理执行引入的固有非确定性——即使初始条件完全相同,运行间及环境间仍存在显著差异。最后,识别出当前模拟器栈中的四种经验随机性模式,表明在无明确约束下无限扩展可能破坏实验可复现性。
原文摘要 · Abstract (English)
Data-driven embodied AI is rapidly transitioning into a paradigm that scales training through massively parallel simulation, where GPU-accelerated simulators serve as the foundational data infrastructure. However, as computational throughput scales, the underlying trade-offs between parallel efficiency, physical fidelity, and execution determinism remain largely unexamined, hindering the development of reliable robot learning. In this paper, we expose the hidden limits of mainstream GPU-based robotic simulators (e.g., Isaac Lab, Genesis) by introducing GPUSimBench, which focuses on scalability, physical consistency, and computational determinism. First, GPUSimBench establishes a physical grounding evaluation with a controlled inclined-plane task, quantifying the distributional alignment between simulated dynamics and their real-world counterparts. Second, we benchmark parallel scalability by measuring throughput and memory footprints across scaling environment counts. Crucially, beyond standard performance metrics, we unveil and quantify the inherent non-determinism introduced by GPU-batched execution, characterized by significant run-to-run and inter-environment variability even under identical initial conditions. Finally, we identify four empirical regimes of stochasticity within current simulator stacks, highlighting that unbounded scaling can compromise reproducibility without explicit constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。