用Transformer在不依赖物理参数的情况下建模机械臂动力学,实现高精度轨迹预测。
RoboMorph: In-Context Meta-Learning for Robot Dynamics Modeling
- 基于上下文学习的元动力学建模,通过扭矩信号预测关节位置和末端位姿。
- 在Franka机械臂上实现90%以上的轨迹预测精度,优于传统方法。
- 适合机器人控制、模型预测控制等需快速建模的场景。
深度学习领域因基于Transformer的架构广泛应用而发生重大转变,尤其在自然语言处理(NLP)中表现突出。尽管已有研究探索其在偏微分方程求解与图像视觉中的应用,但在机器人等高度非线性挑战领域,基于Transformer的应用仍较少。虽然已有工作利用Transformer赋予机器人高层任务知识,但针对系统辨识的研究极少。本文提出一种新方法,使用基于Transformer的架构,在无先验物理参数的情况下,学习高维物理系统(如Franka机械臂)的元动力学模型。目标是根据各关节的力矩信号,预测感兴趣量(末端位姿与关节位置)。该预测可作为深度模型预测控制框架中的组件。元模型建立力矩与位置之间的关联,并预测完整轨迹。本工作提供了实证证据,证明了上下文学习范式在无需显式物理参数情况下学习机器人动力学的有效性。代码、视频及补充材料见项目网站。
原文摘要 · Abstract (English)
The landscape of Deep Learning has experienced a major shift with the pervasive adoption of Transformer-based architectures, particularly in Natural Language Processing (NLP). Novel avenues for physical applications, such as solving Partial Differential Equations and Image Vision, have been explored. However, in challenging domains like robotics, where high non-linearity poses significant challenges, Transformer-based applications are scarce. While Transformers have been used to provide robots with knowledge about high-level tasks, few efforts have been made to perform system identification. This paper proposes a novel methodology to learn a meta-dynamical model of a high-dimensional physical system, such as the Franka robotic arm, using a Transformer-based architecture without prior knowledge of the system's physical parameters. The objective is to predict quantities of interest (end-effector pose and joint positions) given the torque signals for each joint. This prediction can be useful as a component for Deep Model Predictive Control frameworks in robotics. The meta-model establishes the correlation between torques and positions and predicts the output for the complete trajectory. This work provides empirical evidence of the efficacy of the in-context learning paradigm, suggesting future improvements in learning the dynamics of robotic systems without explicit knowledge of physical parameters. Code, videos, and supplementary materials can be found at project website. See https://sites.google.com/view/robomorph/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。