通过双层优化实现机器人与人的动态交互预测,提升移动操作安全性与效率。
SM2ITH: Safe Mobile Manipulation with Interactive Human Prediction via Task-Hierarchical Bilevel Model Predictive Control
- 采用任务分层双层模型预测控制,同步优化机器人与人类行为
- 在三类场景中均优于基于权重或开环模型的基线方法
- 适合需要人机协同的复杂动态环境,如配送、搬运等任务
移动操作机器人旨在人机共存环境中完成复杂的导航与操作任务序列。尽管近期基于优化的方法(如分层任务模型预测控制,HTMPC)能够高效执行多任务并保证任务优先级,但其主要应用于静态或结构化场景。将此类方法拓展至动态人机环境,需引入能捕捉人类对机器人行为反应的预测模型。本文提出安全移动操作框架SM²ITH,通过双层优化将HTMPC与交互式人类运动预测相结合,同时考虑机器人与人类的动力学特性。该框架在两种移动操作机器人(Stretch 3 和 Ridgeback-UR10)上验证,涵盖三种实验设置:(i) 不同导航与操作优先级的配送任务;(ii) 使用不同人类运动预测模型的连续拾放任务;(iii) 包含对抗性人类行为的交互场景。结果表明,交互式预测显著提升了安全性和协调效率,优于依赖加权目标或开环人类模型的基线方法。
原文摘要 · Abstract (English)
Mobile manipulators are designed to perform complex sequences of navigation and manipulation tasks in human-centered environments. While recent optimization-based methods such as Hierarchical Task Model Predictive Control (HTMPC) enable efficient multitask execution with strict task priorities, they have so far been applied mainly to static or structured scenarios. Extending these approaches to dynamic human-centered environments requires predictive models that capture how humans react to the actions of the robot. This work introduces Safe Mobile Manipulation with Interactive Human Prediction via Task-Hierarchical Bilevel Model Predictive Control (SM$^2$ITH), a unified framework that combines HTMPC with interactive human motion prediction through bilevel optimization that jointly accounts for robot and human dynamics. The framework is validated on two different mobile manipulators, the Stretch 3 and the Ridgeback-UR10, across three experimental settings: (i) delivery tasks with different navigation and manipulation priorities, (ii) sequential pick-and-place tasks with different human motion prediction models, and (iii) interactions involving adversarial human behavior. Our results highlight how interactive prediction enables safe and efficient coordination, outperforming baselines that rely on weighted objectives or open-loop human models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。