用触觉信息让仿真机器人更贴近现实,提升物理交互预测精度。
Contact-Aware Neural Dynamics
- 用神经网络学习接触信息,修正仿真中的动态偏差。
- 结合真实触觉数据,使仿真状态预测误差显著降低。
- 适合做复杂物理交互任务的机器人策略优化与仿真对齐。
高保真物理仿真对可扩展的机器人学习至关重要,但模拟到现实的差距依然存在,尤其在涉及复杂、动态且不连续的物理接触任务中。显式系统辨识方法常因难以调整高维、状态依赖的动态而失效。为此,我们提出一种隐式模拟对齐框架,直接利用接触信息对齐仿真动态。该方法将现成仿真器作为先验,通过学习一个接触感知的神经动力学模型,基于真实观测来修正仿真状态。我们证明,使用机械手的触觉接触信息能有效建模接触密集任务中的非光滑不连续性,构建出由真实数据驱动的动力学模型。该模型显著提升了状态预测精度,并可用于预测策略性能及优化仅在标准仿真中训练的策略,提供了一种可扩展的数据驱动模拟对齐方案。
原文摘要 · Abstract (English)
High-fidelity physics simulation is essential for scalable robotic learning, but the sim-to-real gap persists, especially for tasks involving complex, dynamic, and discontinuous interactions like physical contacts. Explicit system identification, which tunes explicit simulator parameters, is often insufficient to align the intricate, high-dimensional, and state-dependent dynamics of the real world. To overcome this, we propose an implicit sim-to-real alignment framework that learns to directly align the simulator's dynamics with contact information. Our method treats the off-the-shelf simulator as a base prior and learns a contact-aware neural dynamics model to refine simulated states using real-world observations. We show that using tactile contact information from robotic hands can effectively model the non-smooth discontinuities inherent in contact-rich tasks, resulting in a neural dynamics model grounded by real-world data. We demonstrate that this learned forward dynamics model improves state prediction accuracy and can be effectively used to predict policy performance and refine policies trained purely in standard simulators, offering a scalable, data-driven approach to sim-to-real alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。