让人形机器人快速适应复杂任务,支持实时修改与可靠执行。
A System for Fast, Resilient, and Adaptable Loco-Manipulation Behaviors on Humanoid Robots

- 用可编辑的行为架构融合物体功能模板与行为树逻辑
- 支持边走边操作,多任务组合可在数分钟内完成
- 已在多款人形机器人上部署,适合需要灵活应变的场景
人形机器人可在为人类设计的空间中承担繁重、危险或重复性工作。但要胜任此类任务,需协调行走、全身运动、感知、接触控制及操作员监督。本文提出一种本地化、运行时可编辑的行为创作与执行系统,遵循达伯拉机器人挑战赛中发展出的协同设计原则,力求实现最大可观测性、可预测性和可操控性。操作界面始终与机器人同步,支持运行时编辑、监控与修复。系统采用以物体为中心的可操作性模板,结合行为树的组织逻辑,并通过行为场景和原始动作实现运行时可编辑感知。动作原语基于支持边走边动臂的全身体控器,使用并发动作分层算法提升速度。本研究开发的行为库涵盖二十多种真实机器人任务变体,包括旋钮、推杆、杠杆式门把手的推拉操作、多步探索序列、障碍清除及反应式桌到桌操作。该系统已部署于波士顿动力的DRC Atlas、NASA的Valkyrie、IHMC与Boardwalk Robotics的Nadia、Unitree的H1-2及IHMC的Alex等多款人形机器人。实验评估了系统在能力、速度、可靠性以及行为创建、适应、扩展与组合方面的表现,结果表明,可在几分钟或数小时内将现有行为适配、扩展并组合成新任务。视频演示:https://www.youtube.com/playlist?list=PLJK5CTyotYqsfgfnXb-09YNFeBose6uEY。
原文摘要 · Abstract (English)
Humanoid robots could take on physically demanding, hazardous, and repetitive work in spaces built for humans. However, a useful robot for these spaces must coordinate locomotion, whole body motion, perception, contact, and operator supervision. This thesis presents a robot-local, runtime-editable behavior authoring and runtime system. Our system strives to be maximally observable, predictable, and directable following Coactive Design principles developed during the DARPA Robotics Challenge. Our operator interface remains continuously synchronized to the robot for runtime authoring, monitoring, and repair. Our behavior architecture uniquely combines object-centric Affordance Templates, organization and logic inspired by Behavior Trees, and runtime-editable perception through a behavior scene and primitive scene actions. Action primitives build on a whole-body controller that supports moving the arms while walking, and use a concurrent action layering algorithm for speed. The behavior library developed during this work covers more than twenty real-robot task variants, including push and pull doors with knob, push-bar, and lever-handle mechanisms, multi-step exploration sequences, obstacle clearing, and reactive table-to-table manipulation tasks. This behavior system has been deployed on many humanoid robots, such as Boston Dynamics' DRC Atlas, NASA's Valkyrie, IHMC and Boardwalk Robotics' Nadia, Unitree's H1-2, and IHMC's Alex. We evaluate our system across capability, speed, reliability, and speed of behavior creation, adaptation, extension, and combination. Our experiments demonstrate that we can adapt, extend, and combine existing behaviors to create novel loco-manipulation behaviors in minutes or hours. Videos: https://www.youtube.com/playlist?list=PLJK5CTyotYqsfgfnXb-09YNFeBose6uEY.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。