用多智能体算法让机器人协同吊带与轮椅完成转移,精准绑扎吊带。
CART-MPC: Coordinating Assistive Devices for Robot-Assisted Transferring with Multi-Agent Model Predictive Control
- 通过分阶段协作控制机器人、吊带和轮椅三个智能体。
- 在仿真与真实环境中实现零样本跨域泛化,成功绑扎不同形状吊钩的吊带。
- 结合绳结理论与神经加速,提升复杂变形物体操作效率,适合康复机器人研究者。
床到轮椅转移是日常活动中的常见任务,但对负载有限的护理机器人而言极具挑战。本文提出CART-MPC算法,利用吊带与轮椅作为粗略搬运工具,机器人臂负责精细操控可变形的吊带绑带。通过为吊带和轮椅添加执行器与传感器,使其成为算法中的智能体。聚焦于转移过程中的关键子任务——将吊带绑带系到吊杆上,该任务体现了多智能体规划、可变形物体操作及对不同钩型、吊带材质与使用者体型的泛化挑战。为此,我们提出基于分时协作的多智能体模型预测控制框架,采用基于关键点的神经动力学模型表示可变形吊带,并设计融合纽结理论链接数与神经摊销的新型代价函数以加速推理。在RCareWorld仿真环境和真实场景中均验证了有效性:仿真中成功泛化至多种钩型、吊带材质与人体形态;真实世界中实现了零样本的仿真到现实迁移,完成将假人从病床转移到轮椅的吊带绑扎任务。
原文摘要 · Abstract (English)
Bed-to-wheelchair transferring is a ubiquitous activity of daily living (ADL), but especially challenging for caregiving robots with limited payloads. We develop a novel algorithm that leverages the presence of other assistive devices: a Hoyer sling and a wheelchair for coarse manipulation of heavy loads, alongside a robot arm for fine-grained manipulation of deformable objects (Hoyer sling straps). We instrument the Hoyer sling and wheelchair with actuators and sensors so that they can become intelligent agents in the algorithm. We then focus on one subtask of the transferring ADL -- tying Hoyer sling straps to the sling bar -- that exemplifies the challenges of transfer: multi-agent planning, deformable object manipulation, and generalization to varying hook shapes, sling materials, and care recipient bodies. To address these challenges, we propose CART-MPC, a novel algorithm based on turn-taking multi-agent model predictive control that uses a learned neural dynamics model for a keypoint-based representation of the deformable Hoyer sling strap, and a novel cost function that leverages linking numbers from knot theory and neural amortization to accelerate inference. We validate it in both RCareWorld simulation and real-world environments. In simulation, CART-MPC successfully generalizes across diverse hook designs, sling materials, and care recipient body shapes. In the real world, we show zero-shot sim-to-real generalization capabilities to tie deformable Hoyer sling straps on a sling bar towards transferring a manikin from a hospital bed to a wheelchair. See our website for supplementary materials: https://emprise.cs.cornell.edu/cart-mpc/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。