让机器人像人一样用全身接触环境,实现真实世界实时运动控制。
Embrace Collisions: Humanoid Shadowing for Deployable Contact-Agnostics Motions
- 用离散动作指令驱动全身控制,实时响应复杂接触。
- 在随机接触与大幅基座旋转下仍保持稳定运动,实现实时性。
- 适合需要全身交互的部署场景,如地面起身、滚动等任务。
以往的人形机器人研究将机器人视为仅通过脚和手与环境交互的双足移动操作平台。然而,人类会使用身体所有部位与环境互动,例如坐椅子、从地面起身或在地板上翻滚。利用除脚和手外的身体部位接触环境,给模型预测控制和基于强化学习的方法带来巨大挑战。不可预测的接触序列几乎使模型预测控制无法实时规划。零样本仿真到现实的强化学习方法的成功高度依赖于基于GPU的刚体物理模拟器加速和碰撞检测简化。缺乏极端躯干运动的研究使得其他组件(如终止条件、运动指令和奖励设计)的设计变得复杂。为解决这些挑战,我们提出一种通用的人形运动框架,接受离散运动指令,并实时控制机器人的电机动作。借助基于GPU的刚体模拟器,我们训练出一个全身控制策略,能够在真实世界中实时跟随高层运动指令,即使存在随机接触、极大幅度的机器人基座旋转以及非理想运动指令。更多细节见 https://project-instinct.github.io
原文摘要 · Abstract (English)
Previous humanoid robot research works treat the robot as a bipedal mobile manipulation platform, where only the feet and hands contact the environment. However, we humans use all body parts to interact with the world, e.g., we sit in chairs, get up from the ground, or roll on the floor. Contacting the environment using body parts other than feet and hands brings significant challenges in both model-predictive control and reinforcement learning-based methods. An unpredictable contact sequence makes it almost impossible for model-predictive control to plan ahead in real time. The success of the zero-shot sim-to-real reinforcement learning method for humanoids heavily depends on the acceleration of GPU-based rigid-body physical simulator and simplification of the collision detection. Lacking extreme torso movement of the humanoid research makes all other components non-trivial to design, such as termination conditions, motion commands and reward designs. To address these potential challenges, we propose a general humanoid motion framework that takes discrete motion commands and controls the robot's motor action in real time. Using a GPU-accelerated rigid-body simulator, we train a humanoid whole-body control policy that follows the high-level motion command in the real world in real time, even with stochastic contacts and extremely large robot base rotation and not-so-feasible motion command. More details at https://project-instinct.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。