用轨迹数据精准识别机器人参数,提升双足行走稳定性。
Achieving Precise and Reliable Locomotion with Differentiable Simulation-Based System Identification
- 通过可微仿真器从位置速度数据反推系统参数
- 实测显示轨迹漂移减少,运动更稳定
- 适合需要高精度控制的机器人研发团队
精确的系统辨识对减少双足行走中的轨迹漂移至关重要,尤其在强化学习和基于模型的控制中。本文提出一种新型控制框架,将系统辨识融入强化学习训练循环,利用可微仿真器进行参数优化。与依赖直接扭矩测量的传统方法不同,本方法仅使用轨迹数据(位置、速度)和控制输入来估计系统参数。借助可微仿真器MuJoCo-XLA,确保仿真行为与真实运动高度一致。该框架支持质量、惯性等基本物理属性,还能通过神经网络近似处理复杂非线性行为,如高级摩擦模型。实验表明,该框架显著提升了轨迹跟踪性能,有效降低轨迹漂移。
原文摘要 · Abstract (English)
Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. It supports fundamental physical properties such as mass and inertia. Additionally, it handles complex system nonlinear behaviors, including advanced friction models, through neural network approximations. Experimental results show that our framework significantly improves trajectory following.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。