用神经网络建模机器人动力学,实现跨任务泛化与真实数据微调。
Neural Robot Dynamics
- 采用机器人中心的时空不变状态表示,替代传统模拟器底层求解器。
- 在千步仿真中保持稳定准确,支持跨任务与环境泛化。
- 可直接用于神经引擎策略学习,且能通过真实数据微调缩小仿真差距。
现代机器人因自由度高、结构复杂,其精确高效模拟仍具挑战。神经模拟器作为传统解析模拟器的替代方案,能高效预测复杂动力学并适应真实数据;但现有方法多需针对特定应用训练,难以泛化至新任务或环境,主要因全局状态表征不足。本文提出NeRD(Neural Robot Dynamics),一种为刚体连杆结构机器人设计的通用神经动力学模型,用于在接触约束下预测未来状态。NeRD独特地替换解析模拟器中的低层动力学与接触求解器,采用机器人中心且空间不变的模拟状态表示,并作为可互换后端求解器集成到先进机器人模拟器中。大量实验表明,NeRD模拟器在上千次仿真步骤中保持稳定与准确,具备任务与环境配置间的泛化能力,支持仅在神经引擎中进行策略学习,且不同于多数经典模拟器,可从真实世界数据中微调,有效弥合仿真与现实的差距。
原文摘要 · Abstract (English)
Accurate and efficient simulation of modern robots remains challenging due to their high degrees of freedom and intricate mechanisms. Neural simulators have emerged as a promising alternative to traditional analytical simulators, capable of efficiently predicting complex dynamics and adapting to real-world data; however, existing neural simulators typically require application-specific training and fail to generalize to novel tasks and/or environments, primarily due to inadequate representations of the global state. In this work, we address the problem of learning generalizable neural simulators for robots that are structured as articulated rigid bodies. We propose NeRD (Neural Robot Dynamics), learned robot-specific dynamics models for predicting future states for articulated rigid bodies under contact constraints. NeRD uniquely replaces the low-level dynamics and contact solvers in an analytical simulator and employs a robot-centric and spatially-invariant simulation state representation. We integrate the learned NeRD models as an interchangeable backend solver within a state-of-the-art robotics simulator. We conduct extensive experiments to show that the NeRD simulators are stable and accurate over a thousand simulation steps; generalize across tasks and environment configurations; enable policy learning exclusively in a neural engine; and, unlike most classical simulators, can be fine-tuned from real-world data to bridge the gap between simulation and reality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。